Oct 25 22:41:20 user nova-compute[74507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74507) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74507) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74507) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 22:41:20 user nova-compute[74507]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:41:20 user nova-compute[74507]: INFO nova.virt.driver [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 25 22:41:20 user nova-compute[74507]: INFO nova.compute.provider_config [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Acquiring lock "singleton_lock" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Acquired lock "singleton_lock" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Releasing lock "singleton_lock" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Full set of CONF: {{(pid=74507) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ******************************************************************************** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Configuration options gathered from: {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ================================================================================ {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] allow_resize_to_same_host      = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] arq_binding_timeout            = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] backdoor_port                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] backdoor_socket                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] block_device_allocate_retries  = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] block_device_allocate_retries_interval = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cert                           = self.pem {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute_monitors               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] config_dir                     = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] config_drive_format            = iso9660 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] config_source                  = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] console_host                   = user {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] control_exchange               = nova {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cpu_allocation_ratio           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] daemon                         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] debug                          = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_access_ip_network_name = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_availability_zone      = nova {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_ephemeral_format       = ext4 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_green_pool_size        = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] default_schedule_zone          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] disk_allocation_ratio          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] enable_new_services            = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] enabled_apis                   = ['osapi_compute'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] enabled_ssl_apis               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] flat_injected                  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] force_config_drive             = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] force_raw_images               = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] graceful_shutdown_timeout      = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] heal_instance_info_cache_interval = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] host                           = user {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_build_timeout         = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_delete_interval       = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_format                = [instance: %(uuid)s]  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_name_template         = instance-%08x {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_usage_audit           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_usage_audit_period    = month {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:20 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] internal_service_availability_zone = internal {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] key                            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] live_migration_retry_count     = 30 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_config_append              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_dir                        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_file                       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_options                    = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_rotate_interval            = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_rotate_interval_type       = days {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] log_rotation_type              = none {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] long_rpc_timeout               = 1800 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_concurrent_builds          = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_concurrent_live_migrations = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_concurrent_snapshots       = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_local_block_devices        = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_logfile_count              = 30 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] max_logfile_size_mb            = 200 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] maximum_instance_delete_attempts = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metadata_listen                = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metadata_listen_port           = 8775 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metadata_workers               = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] migrate_max_retries            = -1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] mkisofs_cmd                    = genisoimage {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] my_ip                          = 10.0.0.210 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] network_allocate_retries       = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] osapi_compute_listen_port      = 8774 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] osapi_compute_unique_server_name_scope =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] osapi_compute_workers          = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] password_length                = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] periodic_enable                = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] periodic_fuzzy_delay           = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] pointer_model                  = ps2mouse {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] preallocate_images             = none {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] publish_errors                 = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] pybasedir                      = /opt/stack/nova {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ram_allocation_ratio           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rate_limit_burst               = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rate_limit_except_level        = CRITICAL {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rate_limit_interval            = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reboot_timeout                 = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reclaim_instance_interval      = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] record                         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reimage_timeout_per_gb         = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] report_interval                = 120 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rescue_timeout                 = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reserved_host_cpus             = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reserved_host_disk_mb          = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reserved_host_memory_mb        = 512 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] reserved_huge_pages            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] resize_confirm_window          = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] resize_fs_using_block_device   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] resume_guests_state_on_host_boot = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rpc_response_timeout           = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] run_external_periodic_tasks    = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] running_deleted_instance_action = reap {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] running_deleted_instance_poll_interval = 1800 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] running_deleted_instance_timeout = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler_instance_sync_interval = 120 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_down_time              = 720 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] servicegroup_driver            = db {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] shelved_offload_time           = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] shelved_poll_interval          = 3600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] shutdown_timeout               = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] source_is_ipv6                 = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ssl_only                       = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] state_path                     = /opt/stack/data/nova {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] sync_power_state_interval      = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] sync_power_state_pool_size     = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] syslog_log_facility            = LOG_USER {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] tempdir                        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] timeout_nbd                    = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] transport_url                  = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] update_resources_interval      = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_cow_images                 = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_eventlog                   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_journal                    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_json                       = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_rootwrap_daemon            = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_stderr                     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] use_syslog                     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vcpu_pin_set                   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plugging_is_fatal          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plugging_timeout           = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] virt_mkfs                      = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] volume_usage_poll_interval     = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] watch_log_file                 = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] web                            = /usr/share/spice-html5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_concurrency.disable_process_locking = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.auth_strategy              = keystone {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.compute_link_prefix        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.dhcp_domain                = novalocal {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.enable_instance_password   = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.glance_link_prefix         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.instance_list_per_project_cells = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.list_records_by_skipping_down_cells = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.local_metadata_per_cell    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.max_limit                  = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.metadata_cache_expiration  = 15 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.neutron_default_tenant_id  = default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.use_forwarded_for          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.use_neutron_default_nets   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_dynamic_targets = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_jsonfile_path   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.backend                  = dogpile.cache.memcached {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.backend_argument         = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.config_prefix            = cache.oslo {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.dead_timeout             = 60.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.debug_cache_backend      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.enable_retry_client      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.enable_socket_keepalive  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.enabled                  = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.expiration_time          = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.hashclient_retry_attempts = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_dead_retry      = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_password        =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_pool_maxsize    = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_sasl_enabled    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.memcache_username        =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.proxies                  = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.retry_attempts           = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.retry_delay              = 0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.socket_keepalive_count   = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.socket_keepalive_idle    = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.socket_keepalive_interval = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.tls_allowed_ciphers      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.tls_cafile               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.tls_certfile             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.tls_enabled              = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cache.tls_keyfile              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.auth_section            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.auth_type               = password {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.cafile                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.certfile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.collect_timing          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.cross_az_attach         = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.debug                   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.endpoint_template       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.http_retries            = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.insecure                = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.keyfile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.os_region_name          = RegionOne {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.split_loggers           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cinder.timeout                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.cpu_dedicated_set      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.cpu_shared_set         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.image_type_exclude_list = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.max_concurrent_disk_ops = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.max_disk_devices_to_attach = -1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.resource_provider_association_refresh = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.shutdown_retry_interval = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] conductor.workers              = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] console.allowed_origins        = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] console.ssl_ciphers            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] console.ssl_minimum_version    = default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] consoleauth.token_ttl          = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.cafile                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.certfile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.collect_timing          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.connect_retries         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.connect_retry_delay     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.endpoint_override       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.insecure                = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.keyfile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.max_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.min_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.region_name             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.service_name            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.service_type            = accelerator {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.split_loggers           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.status_code_retries     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.timeout                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] cyborg.version                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.backend               = sqlalchemy {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.connection            = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.connection_debug      = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.connection_parameters =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.connection_recycle_time = 3600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.connection_trace      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.db_inc_retry_interval = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.db_max_retries        = 20 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.db_max_retry_interval = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.db_retry_interval     = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.max_overflow          = 50 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.max_pool_size         = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.max_retries           = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.mysql_wsrep_sync_wait = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.pool_timeout          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.retry_interval        = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.slave_connection      = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] database.sqlite_synchronous    = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.backend           = sqlalchemy {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.connection        = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.connection_debug  = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.connection_parameters =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.connection_recycle_time = 3600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.connection_trace  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.db_inc_retry_interval = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.db_max_retries    = 20 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.db_max_retry_interval = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.db_retry_interval = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.max_overflow      = 50 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.max_pool_size     = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.max_retries       = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.pool_timeout      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.retry_interval    = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.slave_connection  = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] api_database.sqlite_synchronous = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] devices.enabled_mdev_types     = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ephemeral_storage_encryption.enabled = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.api_servers             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.cafile                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.certfile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.collect_timing          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.connect_retries         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.connect_retry_delay     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.debug                   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.default_trusted_certificate_ids = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.enable_certificate_validation = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.enable_rbd_download     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.endpoint_override       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.insecure                = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.keyfile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.max_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.min_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.num_retries             = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.rbd_ceph_conf           =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.rbd_connect_timeout     = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.rbd_pool                =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.rbd_user                =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.region_name             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.service_name            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.service_type            = image {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.split_loggers           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.status_code_retries     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.timeout                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.verify_glance_signatures = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] glance.version                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] guestfs.debug                  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.config_drive_cdrom      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.config_drive_inject_password = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.enable_instance_metrics_collection = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.enable_remotefx         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.instances_path_share    =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.iscsi_initiator_list    = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.limit_cpu_features      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.power_state_check_timeframe = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.use_multipath_io        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.volume_attach_retry_count = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.vswitch_name            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] mks.enabled                    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.manager_interval   = 2400 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.precache_concurrency = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.remove_unused_base_images = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] image_cache.subdirectory_name  = _base {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.api_max_retries         = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.api_retry_interval      = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.auth_section            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.auth_type               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.cafile                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.certfile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.collect_timing          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.conductor_group         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.connect_retries         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.connect_retry_delay     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.endpoint_override       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.insecure                = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.keyfile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.max_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.min_version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.peer_list               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.region_name             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.serial_console_state_timeout = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.service_name            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.service_type            = baremetal {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.split_loggers           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.status_code_retries     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.timeout                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ironic.version                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] key_manager.fixed_key          = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.barbican_api_version  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.barbican_endpoint     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.barbican_endpoint_type = public {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.barbican_region_name  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.cafile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.certfile              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.collect_timing        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.insecure              = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.keyfile               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.number_of_retries     = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.retry_delay           = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.send_service_user_token = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.split_loggers         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.timeout               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.verify_ssl            = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican.verify_ssl_path       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.auth_section = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.auth_type = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.cafile   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.certfile = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.collect_timing = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.insecure = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.keyfile  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.split_loggers = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] barbican_service_user.timeout  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.approle_role_id          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.approle_secret_id        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.cafile                   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.certfile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.collect_timing           = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.insecure                 = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.keyfile                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.kv_mountpoint            = secret {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.kv_path                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.kv_version               = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.namespace                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.root_token_id            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.split_loggers            = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.ssl_ca_crt_file          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.timeout                  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.use_ssl                  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.auth_section          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.auth_type             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.cafile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.certfile              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.collect_timing        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.connect_retries       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.connect_retry_delay   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.endpoint_override     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.insecure              = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.keyfile               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.max_version           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.min_version           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.region_name           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.service_name          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.service_type          = identity {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.split_loggers         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.status_code_retries   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.timeout               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] keystone.version               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.connection_uri         =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_mode               = custom {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: WARNING oslo_config.cfg [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_power_governor_high = performance {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_power_governor_low = powersave {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_power_management   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.device_detach_attempts = 8 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.device_detach_timeout  = 20 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.disk_cachemodes        = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.disk_prefix            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.enabled_perf_events    = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.file_backed_memory     = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.gid_maps               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.hw_disk_discard        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.hw_machine_type        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_rbd_glance_store_name =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_rbd_pool        = rbd {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_type            = default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.images_volume_group    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.inject_key             = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.inject_partition       = -2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.inject_password        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.iscsi_iface            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.iser_use_multipath     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_bandwidth = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_downtime = 500 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_inbound_addr = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_permit_post_copy = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_scheme  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_timeout_action = abort {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_tunnelled = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: WARNING oslo_config.cfg [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 25 22:41:21 user nova-compute[74507]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 25 22:41:21 user nova-compute[74507]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 25 22:41:21 user nova-compute[74507]: and ``live_migration_inbound_addr`` respectively.
Oct 25 22:41:21 user nova-compute[74507]: ).  Its value may be silently ignored in the future.
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.live_migration_with_native_tls = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.max_queues             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.nfs_mount_options      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_memory_encrypted_guests = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_pcie_ports         = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.pmem_namespaces        = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.quobyte_client_cfg     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rbd_secret_uuid        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rbd_user               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.remote_filesystem_transport = ssh {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rescue_image_id        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rescue_kernel_id       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rescue_ramdisk_id      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.rx_queue_size          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.smbfs_mount_options    =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.snapshot_compression   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.snapshot_image_format  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.sparse_logical_volumes = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.swtpm_enabled          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.swtpm_group            = tss {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.swtpm_user             = tss {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.sysinfo_serial         = unique {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.tb_cache_size          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.tx_queue_size          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.uid_maps               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.use_virtio_for_bridges = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.virt_type              = kvm {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.volume_clear           = zero {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.volume_clear_size      = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.volume_use_multipath   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_cache_path   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.vzstorage_mount_user   = stack {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.auth_section           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.auth_type              = password {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.cafile                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.certfile               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.collect_timing         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.connect_retries        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.connect_retry_delay    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.default_floating_pool  = public {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.endpoint_override      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.extension_sync_interval = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.http_retries           = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.insecure               = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.keyfile                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.max_version            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.min_version            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.ovs_bridge             = br-int {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.physnets               = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.region_name            = RegionOne {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.service_metadata_proxy = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.service_name           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.service_type           = network {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.split_loggers          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.status_code_retries    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.timeout                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] neutron.version                = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] notifications.bdms_in_notifications = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] notifications.default_level    = INFO {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] notifications.notification_format = unversioned {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] notifications.notify_on_state_change = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] pci.alias                      = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] pci.device_spec                = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] pci.report_in_placement        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.auth_section         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.auth_type            = password {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.cafile               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.certfile             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.collect_timing       = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.connect_retries      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.connect_retry_delay  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.default_domain_id    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.default_domain_name  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.domain_id            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.domain_name          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.endpoint_override    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.insecure             = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.keyfile              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.max_version          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.min_version          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.password             = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.project_domain_id    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.project_domain_name  = Default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.project_id           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.project_name         = service {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.region_name          = RegionOne {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.service_name         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.service_type         = placement {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.split_loggers        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.status_code_retries  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.system_scope         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.timeout              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.trust_id             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.user_domain_id       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.user_domain_name     = Default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.user_id              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.username             = placement {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] placement.version              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.cores                    = 20 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.count_usage_from_placement = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.injected_file_content_bytes = 10240 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.injected_file_path_length = 255 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.injected_files           = 5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.instances                = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.key_pairs                = 100 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.metadata_items           = 128 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.ram                      = 51200 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.recheck_quota            = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.server_group_members     = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] quota.server_groups            = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rdp.enabled                    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.image_metadata_prefilter = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.max_attempts         = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.max_placement_results = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.query_placement_for_image_type_support = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] scheduler.workers              = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.host_subset_size = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.isolated_hosts = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.isolated_images = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.pci_in_placement = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.track_instance_changes = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metrics.required               = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metrics.weight_multiplier      = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] metrics.weight_setting         = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.enabled         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.port_range      = 10000:20000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] serial_console.serialproxy_port = 6083 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.auth_section      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.auth_type         = password {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.cafile            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.certfile          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.collect_timing    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.insecure          = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.keyfile           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.send_service_user_token = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.split_loggers     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] service_user.timeout           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.agent_enabled            = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.enabled                  = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.html5proxy_port          = 6082 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.image_compression        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.jpeg_compression         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.playback_compression     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.server_listen            = 127.0.0.1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.streaming_mode           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] spice.zlib_compression         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] upgrade_levels.baseapi         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] upgrade_levels.cert            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] upgrade_levels.compute         = auto {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] upgrade_levels.conductor       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] upgrade_levels.scheduler       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.auth_section = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.auth_type = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.cafile = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.certfile = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.insecure = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.keyfile = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vendordata_dynamic_auth.timeout = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.api_retry_count         = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.ca_file                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.cache_prefix            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.cluster_name            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.connection_pool_size    = 10 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.console_delay_seconds   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.datastore_regex         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.host_ip                 = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.host_password           = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.host_port               = 443 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.host_username           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.insecure                = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.integration_bridge      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.maximum_objects         = 100 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.pbm_default_policy      = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.pbm_enabled             = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.pbm_wsdl_location       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.serial_port_proxy_uri   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.serial_port_service_uri = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.task_poll_interval      = 0.5 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.use_linked_clone        = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.vnc_keymap              = en-us {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.vnc_port                = 5900 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vmware.vnc_port_total          = 10000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.auth_schemes               = ['none'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.enabled                    = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.novncproxy_port            = 6080 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.server_listen              = 0.0.0.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.vencrypt_ca_certs          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.vencrypt_client_cert       = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vnc.vencrypt_client_key        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.disable_rootwrap   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.enable_numa_live_migration = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.libvirt_disable_apic = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.client_socket_timeout     = 900 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.default_pool_size         = 1000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.keep_alive                = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.max_header_line           = 16384 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.ssl_ca_file               = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.ssl_cert_file             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.ssl_key_file              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.tcp_keepidle              = 600 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] zvm.ca_file                    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] zvm.cloud_connector_url        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] zvm.reachable_timeout          = 300 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.enforce_new_defaults = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.enforce_scope      = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.policy_default_rule = default {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.policy_file        = policy.yaml {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.connection_string     = messaging:// {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.enabled               = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.es_doc_type           = notification {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.es_scroll_size        = 10000 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.es_scroll_time        = 2m {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.filter_error_trace    = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.hmac_keys             = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.sentinel_service_name = mymaster {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.socket_timeout        = 0.1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.trace_requests        = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler.trace_sqlalchemy      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler_jaeger.process_tags   = {} {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler_jaeger.service_name_prefix = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] profiler_otlp.service_name_prefix = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] remote_debug.host              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] remote_debug.port              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_notifications.retry = -1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.auth_section        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.auth_type           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.cafile              = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.certfile            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.collect_timing      = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.connect_retries     = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.connect_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.endpoint_id         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.endpoint_override   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.insecure            = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.keyfile             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.max_version         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.min_version         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.region_name         = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.service_name        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.service_type        = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.split_loggers       = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.status_code_retries = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.status_code_retry_delay = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.timeout             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.valid_interfaces    = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_limit.version             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_reports.file_event_handler = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] oslo_reports.log_dir           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.group  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] vif_plug_ovs_privileged.user   = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.flat_interface = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.isolate_vif         = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_vif_ovs.per_port_bridge     = False {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] os_brick.lock_path             = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.capabilities   = [21] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.group          = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.helper_command = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] privsep_osbrick.user           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.group           = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.helper_command  = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] nova_sys_admin.user            = None {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG oslo_service.service [None req-44b66f46-da04-4db0-aa0d-bfe1ce99711f None None] ******************************************************************************** {{(pid=74507) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 25 22:41:21 user nova-compute[74507]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Connecting to libvirt: qemu:///system {{(pid=74507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4b6c846a40> {{(pid=74507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 25 22:41:21 user nova-compute[74507]: libvirt:  error : internal error: could not initialize domain event timer
Oct 25 22:41:21 user nova-compute[74507]: WARNING nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4b6c846a40> {{(pid=74507) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Starting native event thread {{(pid=74507) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Starting green dispatch thread {{(pid=74507) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Starting connection event dispatch thread {{(pid=74507) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 25 22:41:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Connection event '1' reason 'None'
Oct 25 22:41:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 22:41:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.mount [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Initialising _HostMountState generation 0 {{(pid=74507) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 25 22:41:28 user nova-compute[74507]: INFO nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host capabilities <capabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <host>
Oct 25 22:41:28 user nova-compute[74507]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 25 22:41:28 user nova-compute[74507]:     <cpu>
Oct 25 22:41:28 user nova-compute[74507]:       <arch>x86_64</arch>
Oct 25 22:41:28 user nova-compute[74507]:       <model>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <microcode version='1070'/>
Oct 25 22:41:28 user nova-compute[74507]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='osxsave'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='invtsc'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='rsba'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature name='skip-l1dfl-vmentry'/>
Oct 25 22:41:28 user nova-compute[74507]:       <pages unit='KiB' size='4'/>
Oct 25 22:41:28 user nova-compute[74507]:       <pages unit='KiB' size='2048'/>
Oct 25 22:41:28 user nova-compute[74507]:     </cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <power_management>
Oct 25 22:41:28 user nova-compute[74507]:       <suspend_mem/>
Oct 25 22:41:28 user nova-compute[74507]:       <suspend_disk/>
Oct 25 22:41:28 user nova-compute[74507]:       <suspend_hybrid/>
Oct 25 22:41:28 user nova-compute[74507]:     </power_management>
Oct 25 22:41:28 user nova-compute[74507]:     <iommu support='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <migration_features>
Oct 25 22:41:28 user nova-compute[74507]:       <live/>
Oct 25 22:41:28 user nova-compute[74507]:       <uri_transports>
Oct 25 22:41:28 user nova-compute[74507]:         <uri_transport>tcp</uri_transport>
Oct 25 22:41:28 user nova-compute[74507]:         <uri_transport>rdma</uri_transport>
Oct 25 22:41:28 user nova-compute[74507]:       </uri_transports>
Oct 25 22:41:28 user nova-compute[74507]:     </migration_features>
Oct 25 22:41:28 user nova-compute[74507]:     <topology>
Oct 25 22:41:28 user nova-compute[74507]:       <cells num='2'>
Oct 25 22:41:28 user nova-compute[74507]:         <cell id='0'>
Oct 25 22:41:28 user nova-compute[74507]:           <memory unit='KiB'>8140616</memory>
Oct 25 22:41:28 user nova-compute[74507]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 25 22:41:28 user nova-compute[74507]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 22:41:28 user nova-compute[74507]:           <distances>
Oct 25 22:41:28 user nova-compute[74507]:             <sibling id='0' value='10'/>
Oct 25 22:41:28 user nova-compute[74507]:             <sibling id='1' value='20'/>
Oct 25 22:41:28 user nova-compute[74507]:           </distances>
Oct 25 22:41:28 user nova-compute[74507]:           <cpus num='6'>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 25 22:41:28 user nova-compute[74507]:           </cpus>
Oct 25 22:41:28 user nova-compute[74507]:         </cell>
Oct 25 22:41:28 user nova-compute[74507]:         <cell id='1'>
Oct 25 22:41:28 user nova-compute[74507]:           <memory unit='KiB'>8255100</memory>
Oct 25 22:41:28 user nova-compute[74507]:           <pages unit='KiB' size='4'>2063775</pages>
Oct 25 22:41:28 user nova-compute[74507]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 22:41:28 user nova-compute[74507]:           <distances>
Oct 25 22:41:28 user nova-compute[74507]:             <sibling id='0' value='20'/>
Oct 25 22:41:28 user nova-compute[74507]:             <sibling id='1' value='10'/>
Oct 25 22:41:28 user nova-compute[74507]:           </distances>
Oct 25 22:41:28 user nova-compute[74507]:           <cpus num='6'>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 25 22:41:28 user nova-compute[74507]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 25 22:41:28 user nova-compute[74507]:           </cpus>
Oct 25 22:41:28 user nova-compute[74507]:         </cell>
Oct 25 22:41:28 user nova-compute[74507]:       </cells>
Oct 25 22:41:28 user nova-compute[74507]:     </topology>
Oct 25 22:41:28 user nova-compute[74507]:     <cache>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 25 22:41:28 user nova-compute[74507]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 25 22:41:28 user nova-compute[74507]:     </cache>
Oct 25 22:41:28 user nova-compute[74507]:     <secmodel>
Oct 25 22:41:28 user nova-compute[74507]:       <model>apparmor</model>
Oct 25 22:41:28 user nova-compute[74507]:       <doi>0</doi>
Oct 25 22:41:28 user nova-compute[74507]:     </secmodel>
Oct 25 22:41:28 user nova-compute[74507]:     <secmodel>
Oct 25 22:41:28 user nova-compute[74507]:       <model>dac</model>
Oct 25 22:41:28 user nova-compute[74507]:       <doi>0</doi>
Oct 25 22:41:28 user nova-compute[74507]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 25 22:41:28 user nova-compute[74507]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 25 22:41:28 user nova-compute[74507]:     </secmodel>
Oct 25 22:41:28 user nova-compute[74507]:   </host>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='alpha'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>clipper</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='armv6l'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>spitz</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>nuri</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>kzm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>z2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>tosa</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n810</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>terrier</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>midway</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>microbit</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>verdex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>highbank</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>akita</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>connex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>collie</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='armv7l'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>spitz</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>nuri</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>kzm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>z2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>tosa</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n810</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>terrier</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>midway</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>microbit</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>verdex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>highbank</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>akita</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>connex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>collie</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='aarch64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>spitz</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>nuri</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>kzm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>z2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>tosa</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n810</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>n800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>terrier</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>midway</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>microbit</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>verdex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>raspi3b</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>highbank</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>akita</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>connex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>collie</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <acpi default='on' toggle='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='cris'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='i686'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>isapc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>microvm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='kvm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <pae/>
Oct 25 22:41:28 user nova-compute[74507]:       <nonpae/>
Oct 25 22:41:28 user nova-compute[74507]:       <acpi default='on' toggle='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:       <apic default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='m68k'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>an5206</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>q800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>next-cube</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='microblaze'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='microblazeel'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='mips'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>malta</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='mipsel'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>malta</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='mips64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>malta</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>pica61</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>magnum</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='mips64el'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>malta</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>pica61</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>magnum</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='16'>boston</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='ppc'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mac99</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>40p</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>taihu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='ppc64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>taihu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>40p</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mac99</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='ppc64le'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>taihu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>40p</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>mac99</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='riscv32'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='8'>spike</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>opentitan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='8'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='riscv64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='8'>spike</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>shakti_c</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='8'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='s390x'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='sh4'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>shix</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>r2d</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='sh4eb'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>shix</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>r2d</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='sparc'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>SS-5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>SS-20</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>LX</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>SS-4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>SS-10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>Voyager</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='sparc64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sun4u</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>niagara</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>sun4v</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='x86_64'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>64</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='1'>isapc</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>microvm</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='kvm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <acpi default='on' toggle='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:       <apic default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='xtensa'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>sim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>kc705</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ml605</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx200</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx60</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]:   <guest>
Oct 25 22:41:28 user nova-compute[74507]:     <os_type>hvm</os_type>
Oct 25 22:41:28 user nova-compute[74507]:     <arch name='xtensaeb'>
Oct 25 22:41:28 user nova-compute[74507]:       <wordsize>32</wordsize>
Oct 25 22:41:28 user nova-compute[74507]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='4'>sim</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>kc705</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ml605</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>virt</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx200</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>lx60</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 22:41:28 user nova-compute[74507]:       <domain type='qemu'/>
Oct 25 22:41:28 user nova-compute[74507]:     </arch>
Oct 25 22:41:28 user nova-compute[74507]:     <features>
Oct 25 22:41:28 user nova-compute[74507]:       <cpuselection/>
Oct 25 22:41:28 user nova-compute[74507]:       <deviceboot/>
Oct 25 22:41:28 user nova-compute[74507]:       <disksnapshot default='on' toggle='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     </features>
Oct 25 22:41:28 user nova-compute[74507]:   </guest>
Oct 25 22:41:28 user nova-compute[74507]: </capabilities>
Oct 25 22:41:28 user nova-compute[74507]: 
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-i440fx-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>i686</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='255'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'/>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='lm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ide</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-q35-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>i686</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='288'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'/>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='lm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-q35-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>i686</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='288'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'/>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='lm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-i440fx-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>i686</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='255'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'/>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='lm'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ide</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-i440fx-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>x86_64</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='255'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>efi</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='invtsc'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='rsba'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ide</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-q35-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>x86_64</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='288'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>efi</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='invtsc'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='rsba'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-q35-jammy</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>x86_64</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='288'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>efi</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='invtsc'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='rsba'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 25 22:41:28 user nova-compute[74507]: <domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 22:41:28 user nova-compute[74507]:   <domain>kvm</domain>
Oct 25 22:41:28 user nova-compute[74507]:   <machine>pc-i440fx-6.2</machine>
Oct 25 22:41:28 user nova-compute[74507]:   <arch>x86_64</arch>
Oct 25 22:41:28 user nova-compute[74507]:   <vcpu max='255'/>
Oct 25 22:41:28 user nova-compute[74507]:   <iothreads supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:   <os supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='firmware'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>efi</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:     <loader supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>rom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pflash</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='readonly'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>yes</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='secure'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>no</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </loader>
Oct 25 22:41:28 user nova-compute[74507]:   </os>
Oct 25 22:41:28 user nova-compute[74507]:   <cpu>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-passthrough' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='hostPassthroughMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='maximum' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='maximumMigratable'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>on</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>off</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='host-model' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <vendor>Intel</vendor>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ss'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='vmx'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pcid'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='hypervisor'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arat'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='umip'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='md-clear'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='invtsc'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibpb'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='ibrs'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-stibp'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='rsba'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='erms'/>
Oct 25 22:41:28 user nova-compute[74507]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:     <mode name='custom' supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>qemu64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>qemu32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>phenom</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>pentium</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>n270</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm64</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>kvm32</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>coreduo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>core2duo</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>athlon</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Westmere</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Snowridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Skylake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>SandyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Penryn</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G5</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G4</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G3</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Opteron_G2</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Opteron_G1</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>IvyBridge</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Icelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Haswell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Rome</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-Milan</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>EPYC</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Dhyana</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cooperlake</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>Conroe</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='no'>Broadwell</model>
Oct 25 22:41:28 user nova-compute[74507]:       <model usable='yes'>486</model>
Oct 25 22:41:28 user nova-compute[74507]:     </mode>
Oct 25 22:41:28 user nova-compute[74507]:   </cpu>
Oct 25 22:41:28 user nova-compute[74507]:   <memoryBacking supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:     <enum name='sourceType'>
Oct 25 22:41:28 user nova-compute[74507]:       <value>file</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>anonymous</value>
Oct 25 22:41:28 user nova-compute[74507]:       <value>memfd</value>
Oct 25 22:41:28 user nova-compute[74507]:     </enum>
Oct 25 22:41:28 user nova-compute[74507]:   </memoryBacking>
Oct 25 22:41:28 user nova-compute[74507]:   <devices>
Oct 25 22:41:28 user nova-compute[74507]:     <disk supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='diskDevice'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>disk</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cdrom</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>floppy</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>lun</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='bus'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ide</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>fdc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sata</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </disk>
Oct 25 22:41:28 user nova-compute[74507]:     <graphics supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='type'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>sdl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vnc</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>spice</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egl-headless</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </graphics>
Oct 25 22:41:28 user nova-compute[74507]:     <video supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='modelType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>cirrus</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>vmvga</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>qxl</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>none</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>bochs</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>ramfb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </video>
Oct 25 22:41:28 user nova-compute[74507]:     <hostdev supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='mode'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>subsystem</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='startupPolicy'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>default</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>mandatory</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>requisite</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>optional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='subsysType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>usb</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>pci</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>scsi</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='capsType'/>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='pciBackend'/>
Oct 25 22:41:28 user nova-compute[74507]:     </hostdev>
Oct 25 22:41:28 user nova-compute[74507]:     <rng supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtio-non-transitional</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>random</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>egd</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>builtin</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </rng>
Oct 25 22:41:28 user nova-compute[74507]:     <filesystem supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='driverType'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>path</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>handle</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>virtiofs</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </filesystem>
Oct 25 22:41:28 user nova-compute[74507]:     <tpm supported='yes'>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='model'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-tis</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>tpm-crb</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:       <enum name='backendModel'>
Oct 25 22:41:28 user nova-compute[74507]:         <value>passthrough</value>
Oct 25 22:41:28 user nova-compute[74507]:         <value>emulator</value>
Oct 25 22:41:28 user nova-compute[74507]:       </enum>
Oct 25 22:41:28 user nova-compute[74507]:     </tpm>
Oct 25 22:41:28 user nova-compute[74507]:   </devices>
Oct 25 22:41:28 user nova-compute[74507]:   <features>
Oct 25 22:41:28 user nova-compute[74507]:     <gic supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:     <vmcoreinfo supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <genid supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backingStoreInput supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <backup supported='yes'/>
Oct 25 22:41:28 user nova-compute[74507]:     <sev supported='no'/>
Oct 25 22:41:28 user nova-compute[74507]:   </features>
Oct 25 22:41:28 user nova-compute[74507]: </domainCapabilities>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74507) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74507) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Checking secure boot support for host arch (x86_64) {{(pid=74507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Checking secure boot support for host arch (x86_64) {{(pid=74507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Checking secure boot support for host arch (x86_64) {{(pid=74507) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 22:41:28 user nova-compute[74507]: INFO nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Secure Boot support detected
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] cpu compare xml: <cpu match="exact">
Oct 25 22:41:28 user nova-compute[74507]:   <model>Nehalem</model>
Oct 25 22:41:28 user nova-compute[74507]: </cpu>
Oct 25 22:41:28 user nova-compute[74507]:  {{(pid=74507) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 25 22:41:28 user nova-compute[74507]: INFO nova.virt.node [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Generated node identity 9922c2f0-2888-4d6d-8a23-61129bfd5ce8
Oct 25 22:41:28 user nova-compute[74507]: INFO nova.virt.node [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Wrote node identity 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 to /opt/stack/data/nova/compute_id
Oct 25 22:41:28 user nova-compute[74507]: WARNING nova.compute.manager [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Compute nodes ['9922c2f0-2888-4d6d-8a23-61129bfd5ce8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 25 22:41:28 user nova-compute[74507]: INFO nova.compute.manager [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 25 22:41:28 user nova-compute[74507]: WARNING nova.compute.manager [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 22:41:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:41:28 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:41:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:41:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Hypervisor/Node resource view: name=user free_ram=10988MB free_disk=26.038677215576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:41:29 user nova-compute[74507]: WARNING nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] No compute node record for user:9922c2f0-2888-4d6d-8a23-61129bfd5ce8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 could not be found.
Oct 25 22:41:29 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Compute node record created for user:user with uuid: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:41:29 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] [req-e1de4101-3b89-4787-ba6a-c351248c311f] Created resource provider record via placement API for resource provider with UUID 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 and name user.
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74507) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 25 22:41:29 user nova-compute[74507]: INFO nova.virt.libvirt.host [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] kernel doesn't support AMD SEV
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Libvirt baseline CPU <cpu>
Oct 25 22:41:29 user nova-compute[74507]:   <arch>x86_64</arch>
Oct 25 22:41:29 user nova-compute[74507]:   <model>Nehalem</model>
Oct 25 22:41:29 user nova-compute[74507]:   <vendor>Intel</vendor>
Oct 25 22:41:29 user nova-compute[74507]:   <topology sockets="6" cores="1" threads="1"/>
Oct 25 22:41:29 user nova-compute[74507]: </cpu>
Oct 25 22:41:29 user nova-compute[74507]:  {{(pid=74507) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Updated inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Updating resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 generation from 0 to 1 during operation: update_inventory {{(pid=74507) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Updating resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 generation from 1 to 2 during operation: update_traits {{(pid=74507) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.service [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Creating RPC server for service compute {{(pid=74507) start /opt/stack/nova/nova/service.py:182}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.service [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] Join ServiceGroup membership for this service compute {{(pid=74507) start /opt/stack/nova/nova/service.py:199}}
Oct 25 22:41:29 user nova-compute[74507]: DEBUG nova.servicegroup.drivers.db [None req-6b980a9d-31ba-4bcb-b95c-447d5bc3f5e7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74507) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 25 22:41:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:41:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:42:20 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:42:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:42:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=10432MB free_disk=25.942405700683594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:42:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:43:21 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:43:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:43:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=10335MB free_disk=26.006568908691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:43:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:43:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:43:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:22 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:22 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:44:23 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:44:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:44:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=10379MB free_disk=25.760066986083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:44:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:44:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:22 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:23 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:45:24 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:24 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9631MB free_disk=25.780174255371094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:45:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:45:27 user nova-compute[74507]: INFO nova.compute.claims [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Claim successful on node user
Oct 25 22:45:27 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:45:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:45:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Creating image(s)
Oct 25 22:45:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:28 user nova-compute[74507]: DEBUG nova.policy [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4427778755994cca9d47b515e4aed8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70aab19396a0456fbe1e2dc9a8829bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG nova.virt.images [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] 541b34fc-25d4-4dab-841b-3fd7e92cb423 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.part /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.part /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.converted" returned: 0 in 0.386s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.594s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:29 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4fm2vacy/privsep.sock']
Oct 25 22:45:29 user sudo[83756]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4fm2vacy/privsep.sock
Oct 25 22:45:29 user sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 22:45:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:45:30 user nova-compute[74507]: INFO nova.compute.claims [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Claim successful on node user
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Successfully created port: bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:45:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:45:30 user nova-compute[74507]: DEBUG nova.policy [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4427778755994cca9d47b515e4aed8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70aab19396a0456fbe1e2dc9a8829bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:45:31 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:45:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:45:31 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Creating image(s)
Oct 25 22:45:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:31 user sudo[83756]: pam_unix(sudo:session): session closed for user root
Oct 25 22:45:31 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Spawned new privsep daemon via rootwrap
Oct 25 22:45:31 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 22:45:31 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 22:45:31 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 25 22:45:31 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83762
Oct 25 22:45:31 user nova-compute[74507]: WARNING oslo_privsep.priv_context [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] privsep daemon already running
Oct 25 22:45:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk 1073741824" returned: 0 in 0.054s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.237s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Successfully created port: 591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk 1073741824" returned: 0 in 0.051s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Cannot resize image /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Ensure instance console log exists: /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Cannot resize image /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Ensure instance console log exists: /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Successfully updated port: bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-changed-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Refreshing instance network info cache due to event network-changed-bffb64da-2a84-46a7-a0eb-383e1d71cf4f. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:45:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance network_info: |[{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.neutron [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Refreshing network info cache for port bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start _get_guest_xml network_info=[{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:45:34 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:34 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851963803',display_name='tempest-ServerRescueNegativeTestJSON-server-1851963803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851963803',id=1,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-55d4youq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:28Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=de04d5f3-1651-4661-bc81-390182180af3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:45:34 user nova-compute[74507]:   <uuid>de04d5f3-1651-4661-bc81-390182180af3</uuid>
Oct 25 22:45:34 user nova-compute[74507]:   <name>instance-00000001</name>
Oct 25 22:45:34 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:45:34 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:45:34 user nova-compute[74507]:   <metadata>
Oct 25 22:45:34 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:45:34 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1851963803</nova:name>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:45:34</nova:creationTime>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:45:34 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:45:34 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:owner>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:45:34 user nova-compute[74507]:       </nova:owner>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:45:34 user nova-compute[74507]:       <nova:ports>
Oct 25 22:45:34 user nova-compute[74507]:         <nova:port uuid="bffb64da-2a84-46a7-a0eb-383e1d71cf4f">
Oct 25 22:45:34 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 22:45:34 user nova-compute[74507]:         </nova:port>
Oct 25 22:45:34 user nova-compute[74507]:       </nova:ports>
Oct 25 22:45:34 user nova-compute[74507]:     </nova:instance>
Oct 25 22:45:34 user nova-compute[74507]:   </metadata>
Oct 25 22:45:34 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:45:34 user nova-compute[74507]:     <system>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="serial">de04d5f3-1651-4661-bc81-390182180af3</entry>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="uuid">de04d5f3-1651-4661-bc81-390182180af3</entry>
Oct 25 22:45:34 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:45:34 user nova-compute[74507]:     </system>
Oct 25 22:45:34 user nova-compute[74507]:   </sysinfo>
Oct 25 22:45:34 user nova-compute[74507]:   <os>
Oct 25 22:45:34 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:45:34 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:45:34 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:45:34 user nova-compute[74507]:   </os>
Oct 25 22:45:34 user nova-compute[74507]:   <features>
Oct 25 22:45:34 user nova-compute[74507]:     <acpi/>
Oct 25 22:45:34 user nova-compute[74507]:     <apic/>
Oct 25 22:45:34 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:45:34 user nova-compute[74507]:   </features>
Oct 25 22:45:34 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:45:34 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:45:34 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:45:34 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:45:34 user nova-compute[74507]:   </clock>
Oct 25 22:45:34 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:45:34 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:45:34 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:45:34 user nova-compute[74507]:   </cpu>
Oct 25 22:45:34 user nova-compute[74507]:   <devices>
Oct 25 22:45:34 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:45:34 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:45:34 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk"/>
Oct 25 22:45:34 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:45:34 user nova-compute[74507]:     </disk>
Oct 25 22:45:34 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:45:34 user nova-compute[74507]:       <mac address="fa:16:3e:53:e2:24"/>
Oct 25 22:45:34 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:34 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:45:34 user nova-compute[74507]:       <target dev="tapbffb64da-2a"/>
Oct 25 22:45:34 user nova-compute[74507]:     </interface>
Oct 25 22:45:34 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:45:34 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/console.log" append="off"/>
Oct 25 22:45:34 user nova-compute[74507]:     </serial>
Oct 25 22:45:34 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:45:34 user nova-compute[74507]:     <video>
Oct 25 22:45:34 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:34 user nova-compute[74507]:     </video>
Oct 25 22:45:34 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:45:34 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:45:34 user nova-compute[74507]:     </rng>
Oct 25 22:45:34 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:45:34 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:45:34 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:45:34 user nova-compute[74507]:     </memballoon>
Oct 25 22:45:34 user nova-compute[74507]:   </devices>
Oct 25 22:45:34 user nova-compute[74507]: </domain>
Oct 25 22:45:34 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851963803',display_name='tempest-ServerRescueNegativeTestJSON-server-1851963803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851963803',id=1,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-55d4youq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:28Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=de04d5f3-1651-4661-bc81-390182180af3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG os_vif [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Created schema index Interface.name {{(pid=74507) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Created schema index Port.name {{(pid=74507) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Created schema index Bridge.name {{(pid=74507) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [POLLOUT] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b96f0fb4-ac2f-516c-a21d-6460a662bf48', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:34 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph213quf2/privsep.sock']
Oct 25 22:45:34 user sudo[83796]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph213quf2/privsep.sock
Oct 25 22:45:34 user sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Successfully updated port: 591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updated VIF entry in instance network info cache for port bffb64da-2a84-46a7-a0eb-383e1d71cf4f. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0dd074a7-479a-43e0-aba9-b4b7749a6f7a req-0ecf4116-9552-41cb-8a36-9199814f61e9 service nova] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-changed-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Refreshing instance network info cache due to event network-changed-591a03ae-3857-490f-8720-e64e5fa6c309. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:45:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:36 user sudo[83796]: pam_unix(sudo:session): session closed for user root
Oct 25 22:45:36 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Spawned new privsep daemon via rootwrap
Oct 25 22:45:36 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 22:45:36 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 22:45:36 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 25 22:45:36 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83801
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance network_info: |[{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.neutron [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Refreshing network info cache for port 591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start _get_guest_xml network_info=[{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:45:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-889577759',display_name='tempest-ServerRescueNegativeTestJSON-server-889577759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-889577759',id=2,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-go0dc7hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:31Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=85b692bd-0a00-4dd1-9ce1-cfc0e077818f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:45:36 user nova-compute[74507]:   <uuid>85b692bd-0a00-4dd1-9ce1-cfc0e077818f</uuid>
Oct 25 22:45:36 user nova-compute[74507]:   <name>instance-00000002</name>
Oct 25 22:45:36 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:45:36 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:45:36 user nova-compute[74507]:   <metadata>
Oct 25 22:45:36 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:45:36 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-889577759</nova:name>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:45:36</nova:creationTime>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:45:36 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:45:36 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:owner>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:45:36 user nova-compute[74507]:       </nova:owner>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:45:36 user nova-compute[74507]:       <nova:ports>
Oct 25 22:45:36 user nova-compute[74507]:         <nova:port uuid="591a03ae-3857-490f-8720-e64e5fa6c309">
Oct 25 22:45:36 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:45:36 user nova-compute[74507]:         </nova:port>
Oct 25 22:45:36 user nova-compute[74507]:       </nova:ports>
Oct 25 22:45:36 user nova-compute[74507]:     </nova:instance>
Oct 25 22:45:36 user nova-compute[74507]:   </metadata>
Oct 25 22:45:36 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:45:36 user nova-compute[74507]:     <system>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="serial">85b692bd-0a00-4dd1-9ce1-cfc0e077818f</entry>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="uuid">85b692bd-0a00-4dd1-9ce1-cfc0e077818f</entry>
Oct 25 22:45:36 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:45:36 user nova-compute[74507]:     </system>
Oct 25 22:45:36 user nova-compute[74507]:   </sysinfo>
Oct 25 22:45:36 user nova-compute[74507]:   <os>
Oct 25 22:45:36 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:45:36 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:45:36 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:45:36 user nova-compute[74507]:   </os>
Oct 25 22:45:36 user nova-compute[74507]:   <features>
Oct 25 22:45:36 user nova-compute[74507]:     <acpi/>
Oct 25 22:45:36 user nova-compute[74507]:     <apic/>
Oct 25 22:45:36 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:45:36 user nova-compute[74507]:   </features>
Oct 25 22:45:36 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:45:36 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:45:36 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:45:36 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:45:36 user nova-compute[74507]:   </clock>
Oct 25 22:45:36 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:45:36 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:45:36 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:45:36 user nova-compute[74507]:   </cpu>
Oct 25 22:45:36 user nova-compute[74507]:   <devices>
Oct 25 22:45:36 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:45:36 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:45:36 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk"/>
Oct 25 22:45:36 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:45:36 user nova-compute[74507]:     </disk>
Oct 25 22:45:36 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:45:36 user nova-compute[74507]:       <mac address="fa:16:3e:a1:47:5e"/>
Oct 25 22:45:36 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:36 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:45:36 user nova-compute[74507]:       <target dev="tap591a03ae-38"/>
Oct 25 22:45:36 user nova-compute[74507]:     </interface>
Oct 25 22:45:36 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:45:36 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/console.log" append="off"/>
Oct 25 22:45:36 user nova-compute[74507]:     </serial>
Oct 25 22:45:36 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:45:36 user nova-compute[74507]:     <video>
Oct 25 22:45:36 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:36 user nova-compute[74507]:     </video>
Oct 25 22:45:36 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:45:36 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:45:36 user nova-compute[74507]:     </rng>
Oct 25 22:45:36 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:45:36 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:45:36 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:45:36 user nova-compute[74507]:     </memballoon>
Oct 25 22:45:36 user nova-compute[74507]:   </devices>
Oct 25 22:45:36 user nova-compute[74507]: </domain>
Oct 25 22:45:36 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-889577759',display_name='tempest-ServerRescueNegativeTestJSON-server-889577759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-889577759',id=2,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-go0dc7hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:31Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=85b692bd-0a00-4dd1-9ce1-cfc0e077818f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG os_vif [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8f32283-0743-5757-88fa-2b2e85804d45', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap591a03ae-38, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap591a03ae-38, col_values=(('qos', UUID('2ebe578b-4795-4458-bf6e-3da56a8add7f')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap591a03ae-38, col_values=(('external_ids', {'iface-id': '591a03ae-3857-490f-8720-e64e5fa6c309', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:47:5e', 'vm-uuid': '85b692bd-0a00-4dd1-9ce1-cfc0e077818f'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: INFO os_vif [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38')
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbffb64da-2a, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbffb64da-2a, col_values=(('qos', UUID('664628e5-e9bc-4ebd-89cb-4b3000a16ad2')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbffb64da-2a, col_values=(('external_ids', {'iface-id': 'bffb64da-2a84-46a7-a0eb-383e1d71cf4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:e2:24', 'vm-uuid': 'de04d5f3-1651-4661-bc81-390182180af3'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:36 user nova-compute[74507]: INFO os_vif [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a')
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:a1:47:5e, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:45:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:53:e2:24, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:45:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updated VIF entry in instance network info cache for port 591a03ae-3857-490f-8720-e64e5fa6c309. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f942ec8-757a-47c6-ad6b-9f7f4c1b4a0e req-3b702454-b238-4f61-b701-b61d4526e0cd service nova] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:45:38 user nova-compute[74507]: INFO nova.compute.claims [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Claim successful on node user
Oct 25 22:45:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:45:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:45:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Creating image(s)
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:38 user nova-compute[74507]: DEBUG nova.policy [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40a2834cde90449e8067ae627d799836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bae88be410b4835bd2e0470ed90a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk 1073741824" returned: 0 in 0.089s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.211s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Cannot resize image /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Ensure instance console log exists: /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:45:40 user nova-compute[74507]: INFO nova.compute.claims [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Claim successful on node user
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Successfully created port: a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:45:40 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.compute.claims [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Claim successful on node user
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Creating image(s)
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.233s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.165s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk 1073741824" returned: 0 in 0.058s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance spawned successfully.
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:45:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Creating image(s)
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:45:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance spawned successfully.
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.243s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:42 user nova-compute[74507]: INFO nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Took 11.14 seconds to spawn the instance on the hypervisor.
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.policy [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62ab99f645064dacb32c07b5beae3f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9cb2b4089144f4b19cd0a3cba46a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.284s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: INFO nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Took 14.06 seconds to spawn the instance on the hypervisor.
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.policy [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '625b3a2950ec4561a10239c20a13f93e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef98410fe55b43ed8778fc75104265b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Cannot resize image /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Ensure instance console log exists: /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:42 user nova-compute[74507]: INFO nova.compute.manager [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Took 12.24 seconds to build instance.
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ee958823-4b22-47a5-a4f3-1afc7d3cfeea tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.401s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:42 user nova-compute[74507]: INFO nova.compute.manager [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Took 15.28 seconds to build instance.
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.293s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1634041f-4d28-48a1-8db9-e274a0b19a29 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.544s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk 1073741824" returned: 0 in 0.053s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Successfully updated port: a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing instance network info cache due to event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG nova.network.neutron [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing network info cache for port a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:45:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG nova.network.neutron [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Cannot resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Ensure instance console log exists: /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:43 user nova-compute[74507]: DEBUG nova.network.neutron [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-25ca24cc-c1b9-4345-8883-bf6dbdb62608 req-ca570a10-9c5a-4eb4-abb6-354a4e13dcaa service nova] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Successfully created port: 76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance network_info: |[{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Start _get_guest_xml network_info=[{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:45:45 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:45 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221105648',display_name='tempest-ServerActionsTestOtherA-server-221105648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221105648',id=3,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-706nzjuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=d5a1f112-41ec-401b-858a-86f213d3003b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'pci_devices' on Instance uuid d5a1f112-41ec-401b-858a-86f213d3003b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:45:45 user nova-compute[74507]:   <uuid>d5a1f112-41ec-401b-858a-86f213d3003b</uuid>
Oct 25 22:45:45 user nova-compute[74507]:   <name>instance-00000003</name>
Oct 25 22:45:45 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:45:45 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:45:45 user nova-compute[74507]:   <metadata>
Oct 25 22:45:45 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:45:45 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherA-server-221105648</nova:name>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:45:45</nova:creationTime>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:45:45 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:45:45 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:owner>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:user uuid="40a2834cde90449e8067ae627d799836">tempest-ServerActionsTestOtherA-1402899626-project-member</nova:user>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:project uuid="0bae88be410b4835bd2e0470ed90a895">tempest-ServerActionsTestOtherA-1402899626</nova:project>
Oct 25 22:45:45 user nova-compute[74507]:       </nova:owner>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:45:45 user nova-compute[74507]:       <nova:ports>
Oct 25 22:45:45 user nova-compute[74507]:         <nova:port uuid="a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b">
Oct 25 22:45:45 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 22:45:45 user nova-compute[74507]:         </nova:port>
Oct 25 22:45:45 user nova-compute[74507]:       </nova:ports>
Oct 25 22:45:45 user nova-compute[74507]:     </nova:instance>
Oct 25 22:45:45 user nova-compute[74507]:   </metadata>
Oct 25 22:45:45 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:45:45 user nova-compute[74507]:     <system>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="serial">d5a1f112-41ec-401b-858a-86f213d3003b</entry>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="uuid">d5a1f112-41ec-401b-858a-86f213d3003b</entry>
Oct 25 22:45:45 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:45:45 user nova-compute[74507]:     </system>
Oct 25 22:45:45 user nova-compute[74507]:   </sysinfo>
Oct 25 22:45:45 user nova-compute[74507]:   <os>
Oct 25 22:45:45 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:45:45 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:45:45 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:45:45 user nova-compute[74507]:   </os>
Oct 25 22:45:45 user nova-compute[74507]:   <features>
Oct 25 22:45:45 user nova-compute[74507]:     <acpi/>
Oct 25 22:45:45 user nova-compute[74507]:     <apic/>
Oct 25 22:45:45 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:45:45 user nova-compute[74507]:   </features>
Oct 25 22:45:45 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:45:45 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:45:45 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:45:45 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:45:45 user nova-compute[74507]:   </clock>
Oct 25 22:45:45 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:45:45 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:45:45 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:45:45 user nova-compute[74507]:   </cpu>
Oct 25 22:45:45 user nova-compute[74507]:   <devices>
Oct 25 22:45:45 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:45:45 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:45:45 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk"/>
Oct 25 22:45:45 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:45:45 user nova-compute[74507]:     </disk>
Oct 25 22:45:45 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:45:45 user nova-compute[74507]:       <mac address="fa:16:3e:a6:f4:3a"/>
Oct 25 22:45:45 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:45 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:45:45 user nova-compute[74507]:       <target dev="tapa6121d5d-6d"/>
Oct 25 22:45:45 user nova-compute[74507]:     </interface>
Oct 25 22:45:45 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:45:45 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/console.log" append="off"/>
Oct 25 22:45:45 user nova-compute[74507]:     </serial>
Oct 25 22:45:45 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:45:45 user nova-compute[74507]:     <video>
Oct 25 22:45:45 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:45 user nova-compute[74507]:     </video>
Oct 25 22:45:45 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:45:45 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:45:45 user nova-compute[74507]:     </rng>
Oct 25 22:45:45 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:45:45 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:45:45 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:45:45 user nova-compute[74507]:     </memballoon>
Oct 25 22:45:45 user nova-compute[74507]:   </devices>
Oct 25 22:45:45 user nova-compute[74507]: </domain>
Oct 25 22:45:45 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221105648',display_name='tempest-ServerActionsTestOtherA-server-221105648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221105648',id=3,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-706nzjuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=d5a1f112-41ec-401b-858a-86f213d3003b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG os_vif [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bf891d6-9664-5e09-967d-256ea7902e4b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6121d5d-6d, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6121d5d-6d, col_values=(('qos', UUID('fad8fb90-6f6d-4926-9dca-849d5920c00e')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6121d5d-6d, col_values=(('external_ids', {'iface-id': 'a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:f4:3a', 'vm-uuid': 'd5a1f112-41ec-401b-858a-86f213d3003b'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:45 user nova-compute[74507]: INFO os_vif [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d')
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:45:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:a6:f4:3a, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Successfully updated port: 76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-changed-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Refreshing instance network info cache due to event network-changed-76e79bc5-6314-4fde-bb5e-9541d1a48274. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Successfully created port: 41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance network_info: |[{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.neutron [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Refreshing network info cache for port 76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start _get_guest_xml network_info=[{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'pci_devices' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:45:47 user nova-compute[74507]:   <uuid>85d61c17-cfbd-4e09-8bea-04b71f28b94f</uuid>
Oct 25 22:45:47 user nova-compute[74507]:   <name>instance-00000005</name>
Oct 25 22:45:47 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:45:47 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:45:47 user nova-compute[74507]:   <metadata>
Oct 25 22:45:47 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:45:47 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeTestJSON-server-962271633</nova:name>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:45:47</nova:creationTime>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:45:47 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:45:47 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:owner>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:user uuid="62ab99f645064dacb32c07b5beae3f8f">tempest-AttachVolumeTestJSON-1587183484-project-member</nova:user>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:project uuid="0a9cb2b4089144f4b19cd0a3cba46a8e">tempest-AttachVolumeTestJSON-1587183484</nova:project>
Oct 25 22:45:47 user nova-compute[74507]:       </nova:owner>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:45:47 user nova-compute[74507]:       <nova:ports>
Oct 25 22:45:47 user nova-compute[74507]:         <nova:port uuid="76e79bc5-6314-4fde-bb5e-9541d1a48274">
Oct 25 22:45:47 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 22:45:47 user nova-compute[74507]:         </nova:port>
Oct 25 22:45:47 user nova-compute[74507]:       </nova:ports>
Oct 25 22:45:47 user nova-compute[74507]:     </nova:instance>
Oct 25 22:45:47 user nova-compute[74507]:   </metadata>
Oct 25 22:45:47 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:45:47 user nova-compute[74507]:     <system>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="serial">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="uuid">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:45:47 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:45:47 user nova-compute[74507]:     </system>
Oct 25 22:45:47 user nova-compute[74507]:   </sysinfo>
Oct 25 22:45:47 user nova-compute[74507]:   <os>
Oct 25 22:45:47 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:45:47 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:45:47 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:45:47 user nova-compute[74507]:   </os>
Oct 25 22:45:47 user nova-compute[74507]:   <features>
Oct 25 22:45:47 user nova-compute[74507]:     <acpi/>
Oct 25 22:45:47 user nova-compute[74507]:     <apic/>
Oct 25 22:45:47 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:45:47 user nova-compute[74507]:   </features>
Oct 25 22:45:47 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:45:47 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:45:47 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:45:47 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:45:47 user nova-compute[74507]:   </clock>
Oct 25 22:45:47 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:45:47 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:45:47 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:45:47 user nova-compute[74507]:   </cpu>
Oct 25 22:45:47 user nova-compute[74507]:   <devices>
Oct 25 22:45:47 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:45:47 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:45:47 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk"/>
Oct 25 22:45:47 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:45:47 user nova-compute[74507]:     </disk>
Oct 25 22:45:47 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:45:47 user nova-compute[74507]:       <mac address="fa:16:3e:e7:ff:6d"/>
Oct 25 22:45:47 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:47 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:45:47 user nova-compute[74507]:       <target dev="tap76e79bc5-63"/>
Oct 25 22:45:47 user nova-compute[74507]:     </interface>
Oct 25 22:45:47 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:45:47 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/console.log" append="off"/>
Oct 25 22:45:47 user nova-compute[74507]:     </serial>
Oct 25 22:45:47 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:45:47 user nova-compute[74507]:     <video>
Oct 25 22:45:47 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:47 user nova-compute[74507]:     </video>
Oct 25 22:45:47 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:45:47 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:45:47 user nova-compute[74507]:     </rng>
Oct 25 22:45:47 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:45:47 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:45:47 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:45:47 user nova-compute[74507]:     </memballoon>
Oct 25 22:45:47 user nova-compute[74507]:   </devices>
Oct 25 22:45:47 user nova-compute[74507]: </domain>
Oct 25 22:45:47 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG os_vif [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0979985-7805-57b4-9360-02c8ad84496a', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e79bc5-63, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e79bc5-63, col_values=(('qos', UUID('2993529c-d65e-4eac-9217-4caf0b0c3e97')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e79bc5-63, col_values=(('external_ids', {'iface-id': '76e79bc5-6314-4fde-bb5e-9541d1a48274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ff:6d', 'vm-uuid': '85d61c17-cfbd-4e09-8bea-04b71f28b94f'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: INFO os_vif [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No VIF found with MAC fa:16:3e:e7:ff:6d, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.neutron [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updated VIF entry in instance network info cache for port 76e79bc5-6314-4fde-bb5e-9541d1a48274. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG nova.network.neutron [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02d1264e-4bdb-4725-9e0e-5224406d2fe5 req-04fb9441-2b2d-4aca-b7d3-3f533b927338 service nova] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Successfully updated port: 41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-changed-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Refreshing instance network info cache due to event network-changed-41549664-f691-487a-b621-4498583fbb63. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance network_info: |[{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.neutron [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Refreshing network info cache for port 41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start _get_guest_xml network_info=[{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:45:51 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:51 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.objects.instance [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:45:51 user nova-compute[74507]:   <uuid>3c5361aa-2b96-4c06-b93b-009858e427f2</uuid>
Oct 25 22:45:51 user nova-compute[74507]:   <name>instance-00000004</name>
Oct 25 22:45:51 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:45:51 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:45:51 user nova-compute[74507]:   <metadata>
Oct 25 22:45:51 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:45:51 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherB-server-1672474875</nova:name>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:45:51</nova:creationTime>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:45:51 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:45:51 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:owner>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:user uuid="625b3a2950ec4561a10239c20a13f93e">tempest-ServerActionsTestOtherB-1115493463-project-member</nova:user>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:project uuid="ef98410fe55b43ed8778fc75104265b2">tempest-ServerActionsTestOtherB-1115493463</nova:project>
Oct 25 22:45:51 user nova-compute[74507]:       </nova:owner>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:45:51 user nova-compute[74507]:       <nova:ports>
Oct 25 22:45:51 user nova-compute[74507]:         <nova:port uuid="41549664-f691-487a-b621-4498583fbb63">
Oct 25 22:45:51 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:45:51 user nova-compute[74507]:         </nova:port>
Oct 25 22:45:51 user nova-compute[74507]:       </nova:ports>
Oct 25 22:45:51 user nova-compute[74507]:     </nova:instance>
Oct 25 22:45:51 user nova-compute[74507]:   </metadata>
Oct 25 22:45:51 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:45:51 user nova-compute[74507]:     <system>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="serial">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="uuid">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:45:51 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:45:51 user nova-compute[74507]:     </system>
Oct 25 22:45:51 user nova-compute[74507]:   </sysinfo>
Oct 25 22:45:51 user nova-compute[74507]:   <os>
Oct 25 22:45:51 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:45:51 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:45:51 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:45:51 user nova-compute[74507]:   </os>
Oct 25 22:45:51 user nova-compute[74507]:   <features>
Oct 25 22:45:51 user nova-compute[74507]:     <acpi/>
Oct 25 22:45:51 user nova-compute[74507]:     <apic/>
Oct 25 22:45:51 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:45:51 user nova-compute[74507]:   </features>
Oct 25 22:45:51 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:45:51 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:45:51 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:45:51 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:45:51 user nova-compute[74507]:   </clock>
Oct 25 22:45:51 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:45:51 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:45:51 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:45:51 user nova-compute[74507]:   </cpu>
Oct 25 22:45:51 user nova-compute[74507]:   <devices>
Oct 25 22:45:51 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:45:51 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:45:51 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk"/>
Oct 25 22:45:51 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:45:51 user nova-compute[74507]:     </disk>
Oct 25 22:45:51 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:45:51 user nova-compute[74507]:       <mac address="fa:16:3e:bf:24:13"/>
Oct 25 22:45:51 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:51 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:45:51 user nova-compute[74507]:       <target dev="tap41549664-f6"/>
Oct 25 22:45:51 user nova-compute[74507]:     </interface>
Oct 25 22:45:51 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:45:51 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/console.log" append="off"/>
Oct 25 22:45:51 user nova-compute[74507]:     </serial>
Oct 25 22:45:51 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:45:51 user nova-compute[74507]:     <video>
Oct 25 22:45:51 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:45:51 user nova-compute[74507]:     </video>
Oct 25 22:45:51 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:45:51 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:45:51 user nova-compute[74507]:     </rng>
Oct 25 22:45:51 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:45:51 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:45:51 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:45:51 user nova-compute[74507]:     </memballoon>
Oct 25 22:45:51 user nova-compute[74507]:   </devices>
Oct 25 22:45:51 user nova-compute[74507]: </domain>
Oct 25 22:45:51 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG os_vif [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09b386f-2497-5747-94ee-de89323ad385', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41549664-f6, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41549664-f6, col_values=(('qos', UUID('c7e695bd-ab46-4a43-ada0-299a838e8d59')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41549664-f6, col_values=(('external_ids', {'iface-id': '41549664-f691-487a-b621-4498583fbb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:24:13', 'vm-uuid': '3c5361aa-2b96-4c06-b93b-009858e427f2'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: INFO os_vif [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:45:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:45:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No VIF found with MAC fa:16:3e:bf:24:13, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:45:52 user nova-compute[74507]: WARNING nova.compute.manager [req-4d1fb8d3-7ee1-4bcc-bee2-5ba3ee39222f req-2a1dbd3e-e0a3-4faa-861e-b7b4f3bc42e5 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state building and task_state spawning.
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:45:52 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance spawned successfully.
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updated VIF entry in instance network info cache for port 41549664-f691-487a-b621-4498583fbb63. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:45:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4229569-e3fd-4736-b0e9-30ed9cfe3c0c req-06e72d11-d49d-4320-939d-205b7903b555 service nova] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:45:53 user nova-compute[74507]: INFO nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Took 14.28 seconds to spawn the instance on the hypervisor.
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:45:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance spawned successfully.
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:53 user nova-compute[74507]: INFO nova.compute.manager [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Took 15.25 seconds to build instance.
Oct 25 22:45:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-14ba2894-cf1a-47c9-9431-60a6f319a9ab tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.420s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:53 user nova-compute[74507]: INFO nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Took 11.52 seconds to spawn the instance on the hypervisor.
Oct 25 22:45:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:53 user nova-compute[74507]: INFO nova.compute.manager [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Took 13.01 seconds to build instance.
Oct 25 22:45:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1fc76dc-1e91-4d26-89ac-40f6ccd6aff4 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.232s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:45:54 user nova-compute[74507]: WARNING nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state active and task_state None.
Oct 25 22:45:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:45:54 user nova-compute[74507]: WARNING nova.compute.manager [req-d805ce41-d1a6-414a-90bd-856e817a263f req-daa49508-c362-4110-9190-3b546107a138 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state building and task_state spawning.
Oct 25 22:45:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:45:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:45:56 user nova-compute[74507]: WARNING nova.compute.manager [req-2db325e0-4e5d-4616-a664-531becbac84f req-e3cfe93c-e23c-4c17-bd8c-c1b13604d383 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state building and task_state spawning.
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:45:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance spawned successfully.
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:45:57 user nova-compute[74507]: INFO nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Took 15.93 seconds to spawn the instance on the hypervisor.
Oct 25 22:45:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:45:57 user nova-compute[74507]: INFO nova.compute.manager [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Took 17.43 seconds to build instance.
Oct 25 22:45:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cf356953-8f87-4686-9b1c-6290db13c3cd tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.645s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:00 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:46:00 user nova-compute[74507]: INFO nova.compute.claims [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Claim successful on node user
Oct 25 22:46:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:46:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.policy [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd3304f393f14ab79afd757ea5f32b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc39403f96043cf828ea29145f20808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:46:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Creating image(s)
Oct 25 22:46:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "/opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "/opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "/opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.330s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.300s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk 1073741824" returned: 0 in 0.088s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:46:02 user nova-compute[74507]: INFO nova.compute.claims [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Claim successful on node user
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.269s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Successfully created port: 614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Cannot resize image /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Ensure instance console log exists: /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:46:03 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.policy [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5956bd3dc93a487db0e2033556c74355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5653ecaa094452859ddf1d8e8a0646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:46:03 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Creating image(s)
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Successfully updated port: 614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-changed-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Refreshing instance network info cache due to event network-changed-614047c4-9225-41e2-b4d7-148df5858276. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] Acquiring lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] Acquired lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Refreshing network info cache for port 614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Successfully created port: 6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.part --force-share --output=json" returned: 0 in 0.305s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.virt.images [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] c02b4555-f785-4279-8d32-4bb7392d7c0a was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.part /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.part /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.converted" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.421s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ab423c2d-8b53-4feb-82b6-bc359af28e68 req-cad17603-f95e-40ad-93a7-afd5059cee15 service nova] Releasing lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquired lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b,backing_fmt=raw /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b,backing_fmt=raw /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk 1073741824" returned: 0 in 0.086s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "d10788b3861cead58cd8e5d020ab3a8d5f616a3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Successfully updated port: 6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b --force-share --output=json" returned: 0 in 0.230s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:46:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquired lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-changed-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Refreshing instance network info cache due to event network-changed-6e7b60f6-5aca-406d-a0b7-4448c01bb558. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] Acquiring lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.neutron [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating instance_info_cache with network_info: [{"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Releasing lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance network_info: |[{"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Start _get_guest_xml network_info=[{"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:46:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-549955582',display_name='tempest-VolumesAdminNegativeTest-server-549955582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-549955582',id=6,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFdTx2s8ksZ96E2mzqzqpAhjcm9850ytjKfCLSUFgRPjq5sRoCSHKFhVMXSDC9rX3VLQJ03KGv6mIspudN6js09/vI8YIiFATAUyDO790FGhsljhSd/JTWqOMIEp87JAw==',key_name='tempest-keypair-44669929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-6rjub2ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=a24bc0e5-a941-49ce-b5f4-36308b71620c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.objects.instance [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'pci_devices' on Instance uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Cannot resize image /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Ensure instance console log exists: /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:46:06 user nova-compute[74507]:   <uuid>a24bc0e5-a941-49ce-b5f4-36308b71620c</uuid>
Oct 25 22:46:06 user nova-compute[74507]:   <name>instance-00000006</name>
Oct 25 22:46:06 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:46:06 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:46:06 user nova-compute[74507]:   <metadata>
Oct 25 22:46:06 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:46:06 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:name>tempest-VolumesAdminNegativeTest-server-549955582</nova:name>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:46:06</nova:creationTime>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:46:06 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:owner>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:user uuid="dd3304f393f14ab79afd757ea5f32b5f">tempest-VolumesAdminNegativeTest-176792302-project-member</nova:user>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:project uuid="efc39403f96043cf828ea29145f20808">tempest-VolumesAdminNegativeTest-176792302</nova:project>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:owner>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:ports>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:port uuid="614047c4-9225-41e2-b4d7-148df5858276">
Oct 25 22:46:06 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 22:46:06 user nova-compute[74507]:         </nova:port>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:ports>
Oct 25 22:46:06 user nova-compute[74507]:     </nova:instance>
Oct 25 22:46:06 user nova-compute[74507]:   </metadata>
Oct 25 22:46:06 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:46:06 user nova-compute[74507]:     <system>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="serial">a24bc0e5-a941-49ce-b5f4-36308b71620c</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="uuid">a24bc0e5-a941-49ce-b5f4-36308b71620c</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:46:06 user nova-compute[74507]:     </system>
Oct 25 22:46:06 user nova-compute[74507]:   </sysinfo>
Oct 25 22:46:06 user nova-compute[74507]:   <os>
Oct 25 22:46:06 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:46:06 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:46:06 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:46:06 user nova-compute[74507]:   </os>
Oct 25 22:46:06 user nova-compute[74507]:   <features>
Oct 25 22:46:06 user nova-compute[74507]:     <acpi/>
Oct 25 22:46:06 user nova-compute[74507]:     <apic/>
Oct 25 22:46:06 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:46:06 user nova-compute[74507]:   </features>
Oct 25 22:46:06 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:46:06 user nova-compute[74507]:   </clock>
Oct 25 22:46:06 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:46:06 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:46:06 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:46:06 user nova-compute[74507]:   </cpu>
Oct 25 22:46:06 user nova-compute[74507]:   <devices>
Oct 25 22:46:06 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:46:06 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:46:06 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk"/>
Oct 25 22:46:06 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:46:06 user nova-compute[74507]:     </disk>
Oct 25 22:46:06 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:46:06 user nova-compute[74507]:       <mac address="fa:16:3e:48:b1:58"/>
Oct 25 22:46:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:06 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:46:06 user nova-compute[74507]:       <target dev="tap614047c4-92"/>
Oct 25 22:46:06 user nova-compute[74507]:     </interface>
Oct 25 22:46:06 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:46:06 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/console.log" append="off"/>
Oct 25 22:46:06 user nova-compute[74507]:     </serial>
Oct 25 22:46:06 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:46:06 user nova-compute[74507]:     <video>
Oct 25 22:46:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:06 user nova-compute[74507]:     </video>
Oct 25 22:46:06 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:46:06 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:46:06 user nova-compute[74507]:     </rng>
Oct 25 22:46:06 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:46:06 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:46:06 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:46:06 user nova-compute[74507]:     </memballoon>
Oct 25 22:46:06 user nova-compute[74507]:   </devices>
Oct 25 22:46:06 user nova-compute[74507]: </domain>
Oct 25 22:46:06 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-549955582',display_name='tempest-VolumesAdminNegativeTest-server-549955582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-549955582',id=6,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFdTx2s8ksZ96E2mzqzqpAhjcm9850ytjKfCLSUFgRPjq5sRoCSHKFhVMXSDC9rX3VLQJ03KGv6mIspudN6js09/vI8YIiFATAUyDO790FGhsljhSd/JTWqOMIEp87JAw==',key_name='tempest-keypair-44669929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-6rjub2ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=a24bc0e5-a941-49ce-b5f4-36308b71620c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG os_vif [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b59700-4144-50bc-9f79-b5bd87bc1c0b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap614047c4-92, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap614047c4-92, col_values=(('qos', UUID('1f1d3049-8b3c-480c-b220-bd1e3e8df708')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap614047c4-92, col_values=(('external_ids', {'iface-id': '614047c4-9225-41e2-b4d7-148df5858276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:b1:58', 'vm-uuid': 'a24bc0e5-a941-49ce-b5f4-36308b71620c'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: INFO os_vif [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92')
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No VIF found with MAC fa:16:3e:48:b1:58, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updating instance_info_cache with network_info: [{"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Releasing lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Instance network_info: |[{"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] Acquired lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Refreshing network info cache for port 6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Start _get_guest_xml network_info=[{"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:45:52Z,direct_url=<?>,disk_format='qcow2',id=c02b4555-f785-4279-8d32-4bb7392d7c0a,min_disk=0,min_ram=0,name='',owner='fbf78535552149e9a903871a77e6cd94',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:45:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'scsi', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'c02b4555-f785-4279-8d32-4bb7392d7c0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:46:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:45:52Z,direct_url=<?>,disk_format='qcow2',id=c02b4555-f785-4279-8d32-4bb7392d7c0a,min_disk=0,min_ram=0,name='',owner='fbf78535552149e9a903871a77e6cd94',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:45:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-805085715',display_name='tempest-AttachSCSIVolumeTestJSON-server-805085715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-805085715',id=7,image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhU2dJgUCD4mHahDArPpkbI/sY05oe+9RoPNeH/3rPMoeTA8Q3VzBx/J8G1D9kPiif+3iDFbVRNYIu/5mACYzhSxg3w0lf7IYYmXDFF4aMP6E4EmvfgIHqpbhJU2HiyAg==',key_name='tempest-keypair-506469757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf5653ecaa094452859ddf1d8e8a0646',ramdisk_id='',reservation_id='r-kjybpez2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-783955555',owner_user_name='tempest-AttachSCSIVolumeTestJSON-783955555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5956bd3dc93a487db0e2033556c74355',uuid=c5fd8bd5-777f-4469-a2fb-34af2f2e2097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converting VIF {"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lazy-loading 'pci_devices' on Instance uuid c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:46:06 user nova-compute[74507]:   <uuid>c5fd8bd5-777f-4469-a2fb-34af2f2e2097</uuid>
Oct 25 22:46:06 user nova-compute[74507]:   <name>instance-00000007</name>
Oct 25 22:46:06 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:46:06 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:46:06 user nova-compute[74507]:   <metadata>
Oct 25 22:46:06 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:46:06 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-805085715</nova:name>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:46:06</nova:creationTime>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:46:06 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:owner>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:user uuid="5956bd3dc93a487db0e2033556c74355">tempest-AttachSCSIVolumeTestJSON-783955555-project-member</nova:user>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:project uuid="cf5653ecaa094452859ddf1d8e8a0646">tempest-AttachSCSIVolumeTestJSON-783955555</nova:project>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:owner>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:root type="image" uuid="c02b4555-f785-4279-8d32-4bb7392d7c0a"/>
Oct 25 22:46:06 user nova-compute[74507]:       <nova:ports>
Oct 25 22:46:06 user nova-compute[74507]:         <nova:port uuid="6e7b60f6-5aca-406d-a0b7-4448c01bb558">
Oct 25 22:46:06 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 22:46:06 user nova-compute[74507]:         </nova:port>
Oct 25 22:46:06 user nova-compute[74507]:       </nova:ports>
Oct 25 22:46:06 user nova-compute[74507]:     </nova:instance>
Oct 25 22:46:06 user nova-compute[74507]:   </metadata>
Oct 25 22:46:06 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:46:06 user nova-compute[74507]:     <system>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="serial">c5fd8bd5-777f-4469-a2fb-34af2f2e2097</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="uuid">c5fd8bd5-777f-4469-a2fb-34af2f2e2097</entry>
Oct 25 22:46:06 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:46:06 user nova-compute[74507]:     </system>
Oct 25 22:46:06 user nova-compute[74507]:   </sysinfo>
Oct 25 22:46:06 user nova-compute[74507]:   <os>
Oct 25 22:46:06 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:46:06 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:46:06 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:46:06 user nova-compute[74507]:   </os>
Oct 25 22:46:06 user nova-compute[74507]:   <features>
Oct 25 22:46:06 user nova-compute[74507]:     <acpi/>
Oct 25 22:46:06 user nova-compute[74507]:     <apic/>
Oct 25 22:46:06 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:46:06 user nova-compute[74507]:   </features>
Oct 25 22:46:06 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:46:06 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:46:06 user nova-compute[74507]:   </clock>
Oct 25 22:46:06 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:46:06 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:46:06 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:46:06 user nova-compute[74507]:   </cpu>
Oct 25 22:46:06 user nova-compute[74507]:   <devices>
Oct 25 22:46:06 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:46:06 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:46:06 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk"/>
Oct 25 22:46:06 user nova-compute[74507]:       <target dev="sda" bus="scsi"/>
Oct 25 22:46:06 user nova-compute[74507]:       <address type="drive" controller="0" unit="0"/>
Oct 25 22:46:06 user nova-compute[74507]:     </disk>
Oct 25 22:46:06 user nova-compute[74507]:     <disk type="file" device="cdrom">
Oct 25 22:46:06 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 22:46:06 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.config"/>
Oct 25 22:46:06 user nova-compute[74507]:       <target dev="sdb" bus="scsi"/>
Oct 25 22:46:06 user nova-compute[74507]:       <address type="drive" controller="0" unit="1"/>
Oct 25 22:46:06 user nova-compute[74507]:     </disk>
Oct 25 22:46:06 user nova-compute[74507]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 25 22:46:06 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:46:06 user nova-compute[74507]:       <mac address="fa:16:3e:d4:01:bf"/>
Oct 25 22:46:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:06 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:46:06 user nova-compute[74507]:       <target dev="tap6e7b60f6-5a"/>
Oct 25 22:46:06 user nova-compute[74507]:     </interface>
Oct 25 22:46:06 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:46:06 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/console.log" append="off"/>
Oct 25 22:46:06 user nova-compute[74507]:     </serial>
Oct 25 22:46:06 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:46:06 user nova-compute[74507]:     <video>
Oct 25 22:46:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:06 user nova-compute[74507]:     </video>
Oct 25 22:46:06 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:46:06 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:46:06 user nova-compute[74507]:     </rng>
Oct 25 22:46:06 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:46:06 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:46:06 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:46:06 user nova-compute[74507]:     </memballoon>
Oct 25 22:46:06 user nova-compute[74507]:   </devices>
Oct 25 22:46:06 user nova-compute[74507]: </domain>
Oct 25 22:46:06 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-805085715',display_name='tempest-AttachSCSIVolumeTestJSON-server-805085715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-805085715',id=7,image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhU2dJgUCD4mHahDArPpkbI/sY05oe+9RoPNeH/3rPMoeTA8Q3VzBx/J8G1D9kPiif+3iDFbVRNYIu/5mACYzhSxg3w0lf7IYYmXDFF4aMP6E4EmvfgIHqpbhJU2HiyAg==',key_name='tempest-keypair-506469757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf5653ecaa094452859ddf1d8e8a0646',ramdisk_id='',reservation_id='r-kjybpez2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-783955555',owner_user_name='tempest-AttachSCSIVolumeTestJSON-783955555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5956bd3dc93a487db0e2033556c74355',uuid=c5fd8bd5-777f-4469-a2fb-34af2f2e2097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converting VIF {"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG os_vif [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fb3e489-e0f6-5cf4-971b-c68510fb1ee9', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7b60f6-5a, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e7b60f6-5a, col_values=(('qos', UUID('54ee63c0-b5c9-49de-a386-b1f509526526')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e7b60f6-5a, col_values=(('external_ids', {'iface-id': '6e7b60f6-5aca-406d-a0b7-4448c01bb558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:01:bf', 'vm-uuid': 'c5fd8bd5-777f-4469-a2fb-34af2f2e2097'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:06 user nova-compute[74507]: INFO os_vif [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a')
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No BDM found with device name sda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No VIF found with MAC fa:16:3e:d4:01:bf, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:46:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Using config drive
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.network.neutron [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updated VIF entry in instance network info cache for port 6e7b60f6-5aca-406d-a0b7-4448c01bb558. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.network.neutron [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updating instance_info_cache with network_info: [{"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4b0c915c-d14c-4f99-b1fe-ebf4df54eb7d req-01b8ad38-0184-4aaa-b70d-4a5518a201c1 service nova] Releasing lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Creating config drive at /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.config
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_1su2cq1 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:46:07 user nova-compute[74507]: INFO nova.compute.claims [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Claim successful on node user
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_1su2cq1" returned: 0 in 0.050s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:07 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.214s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:46:08 user nova-compute[74507]: INFO nova.compute.claims [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Claim successful on node user
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:46:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.policy [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f049158deee3409c821b3e18847139ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7edf40e6c434b09aafbb2aac44a70fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:46:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Creating image(s)
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "/opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "/opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "/opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk 1073741824" returned: 0 in 0.054s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:46:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:46:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.policy [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd641f86e0cb84147bfa1be85f62dcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344fd16a6c1b439b8e1699dba8d809d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Successfully created port: 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:46:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Creating image(s)
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Cannot resize image /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Ensure instance console log exists: /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.267s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.260s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk 1073741824" returned: 0 in 0.152s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.427s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] No waiting events found dispatching network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:09 user nova-compute[74507]: WARNING nova.compute.manager [req-8028253b-54b1-4d97-b51d-d8bb06ad1c09 req-b33af048-f85d-422a-b533-7467c4536cb2 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received unexpected event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 for instance with vm_state building and task_state spawning.
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.270s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Cannot resize image /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Ensure instance console log exists: /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Successfully updated port: 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquired lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Successfully created port: 5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updating instance_info_cache with network_info: [{"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Releasing lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Instance network_info: |[{"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Start _get_guest_xml network_info=[{"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-161006731',display_name='tempest-TestVolumeSwap-server-161006731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-161006731',id=8,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDFlNWA1eFu/We1dNm9owWoIJF/p2nD5c1aV8XksdLTqTfPtnT9ZgaHfkqcGkqpwFhm+nH88gdrjNKjHVAYJS5ldxX7+pcn9StNU+LSl74g63yIuCSheXzNFMNsQJf5Vg==',key_name='tempest-keypair-1320761101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7edf40e6c434b09aafbb2aac44a70fe',ramdisk_id='',reservation_id='r-rfefrpgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-840304522',owner_user_name='tempest-TestVolumeSwap-840304522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f049158deee3409c821b3e18847139ad',uuid=2db7899e-3a31-4fd6-aece-6cf9b669c96b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converting VIF {"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lazy-loading 'pci_devices' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:46:11 user nova-compute[74507]:   <uuid>2db7899e-3a31-4fd6-aece-6cf9b669c96b</uuid>
Oct 25 22:46:11 user nova-compute[74507]:   <name>instance-00000008</name>
Oct 25 22:46:11 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:46:11 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:46:11 user nova-compute[74507]:   <metadata>
Oct 25 22:46:11 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:46:11 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:name>tempest-TestVolumeSwap-server-161006731</nova:name>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:46:11</nova:creationTime>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:46:11 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:46:11 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:owner>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:user uuid="f049158deee3409c821b3e18847139ad">tempest-TestVolumeSwap-840304522-project-member</nova:user>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:project uuid="a7edf40e6c434b09aafbb2aac44a70fe">tempest-TestVolumeSwap-840304522</nova:project>
Oct 25 22:46:11 user nova-compute[74507]:       </nova:owner>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:46:11 user nova-compute[74507]:       <nova:ports>
Oct 25 22:46:11 user nova-compute[74507]:         <nova:port uuid="0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53">
Oct 25 22:46:11 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 22:46:11 user nova-compute[74507]:         </nova:port>
Oct 25 22:46:11 user nova-compute[74507]:       </nova:ports>
Oct 25 22:46:11 user nova-compute[74507]:     </nova:instance>
Oct 25 22:46:11 user nova-compute[74507]:   </metadata>
Oct 25 22:46:11 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:46:11 user nova-compute[74507]:     <system>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="serial">2db7899e-3a31-4fd6-aece-6cf9b669c96b</entry>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="uuid">2db7899e-3a31-4fd6-aece-6cf9b669c96b</entry>
Oct 25 22:46:11 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:46:11 user nova-compute[74507]:     </system>
Oct 25 22:46:11 user nova-compute[74507]:   </sysinfo>
Oct 25 22:46:11 user nova-compute[74507]:   <os>
Oct 25 22:46:11 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:46:11 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:46:11 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:46:11 user nova-compute[74507]:   </os>
Oct 25 22:46:11 user nova-compute[74507]:   <features>
Oct 25 22:46:11 user nova-compute[74507]:     <acpi/>
Oct 25 22:46:11 user nova-compute[74507]:     <apic/>
Oct 25 22:46:11 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:46:11 user nova-compute[74507]:   </features>
Oct 25 22:46:11 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:46:11 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:46:11 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:46:11 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:46:11 user nova-compute[74507]:   </clock>
Oct 25 22:46:11 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:46:11 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:46:11 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:46:11 user nova-compute[74507]:   </cpu>
Oct 25 22:46:11 user nova-compute[74507]:   <devices>
Oct 25 22:46:11 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:46:11 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:46:11 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk"/>
Oct 25 22:46:11 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:46:11 user nova-compute[74507]:     </disk>
Oct 25 22:46:11 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:46:11 user nova-compute[74507]:       <mac address="fa:16:3e:3a:ae:5c"/>
Oct 25 22:46:11 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:11 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:46:11 user nova-compute[74507]:       <target dev="tap0d3ba0dc-68"/>
Oct 25 22:46:11 user nova-compute[74507]:     </interface>
Oct 25 22:46:11 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:46:11 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/console.log" append="off"/>
Oct 25 22:46:11 user nova-compute[74507]:     </serial>
Oct 25 22:46:11 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:46:11 user nova-compute[74507]:     <video>
Oct 25 22:46:11 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:11 user nova-compute[74507]:     </video>
Oct 25 22:46:11 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:46:11 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:46:11 user nova-compute[74507]:     </rng>
Oct 25 22:46:11 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:46:11 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:46:11 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:46:11 user nova-compute[74507]:     </memballoon>
Oct 25 22:46:11 user nova-compute[74507]:   </devices>
Oct 25 22:46:11 user nova-compute[74507]: </domain>
Oct 25 22:46:11 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-161006731',display_name='tempest-TestVolumeSwap-server-161006731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-161006731',id=8,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDFlNWA1eFu/We1dNm9owWoIJF/p2nD5c1aV8XksdLTqTfPtnT9ZgaHfkqcGkqpwFhm+nH88gdrjNKjHVAYJS5ldxX7+pcn9StNU+LSl74g63yIuCSheXzNFMNsQJf5Vg==',key_name='tempest-keypair-1320761101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7edf40e6c434b09aafbb2aac44a70fe',ramdisk_id='',reservation_id='r-rfefrpgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-840304522',owner_user_name='tempest-TestVolumeSwap-840304522-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f049158deee3409c821b3e18847139ad',uuid=2db7899e-3a31-4fd6-aece-6cf9b669c96b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converting VIF {"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG os_vif [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc6fe36-2ff0-574e-b68c-55be26ff0767', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d3ba0dc-68, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d3ba0dc-68, col_values=(('qos', UUID('2ff68aa8-1c84-402c-aa0a-9fad2ea1bb53')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d3ba0dc-68, col_values=(('external_ids', {'iface-id': '0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ae:5c', 'vm-uuid': '2db7899e-3a31-4fd6-aece-6cf9b669c96b'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:11 user nova-compute[74507]: INFO os_vif [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68')
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] No VIF found with MAC fa:16:3e:3a:ae:5c, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] No waiting events found dispatching network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:12 user nova-compute[74507]: WARNING nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received unexpected event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 for instance with vm_state building and task_state spawning.
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] No waiting events found dispatching network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:12 user nova-compute[74507]: WARNING nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received unexpected event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 for instance with vm_state building and task_state spawning.
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-changed-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Refreshing instance network info cache due to event network-changed-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Acquiring lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Acquired lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Refreshing network info cache for port 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Successfully updated port: 5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-changed-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing instance network info cache due to event network-changed-5c7f140a-fa7b-4393-95bd-86a33cc31cc8. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updated VIF entry in instance network info cache for port 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updating instance_info_cache with network_info: [{"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Releasing lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] No waiting events found dispatching network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:12 user nova-compute[74507]: WARNING nova.compute.manager [req-09197d42-141e-4046-854d-d1244b1cd08f req-1bfc3860-91c0-4e04-a2f8-a34daeee3694 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received unexpected event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 for instance with vm_state building and task_state spawning.
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Instance network_info: |[{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing network info cache for port 5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:46:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Start _get_guest_xml network_info=[{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:46:12 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:13 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'pci_devices' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance spawned successfully.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:46:13 user nova-compute[74507]:   <uuid>05535d1f-7a9b-46e6-ba67-4709507a3ee4</uuid>
Oct 25 22:46:13 user nova-compute[74507]:   <name>instance-00000009</name>
Oct 25 22:46:13 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:46:13 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:46:13 user nova-compute[74507]:   <metadata>
Oct 25 22:46:13 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:46:13 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:46:13</nova:creationTime>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:46:13 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:46:13 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:owner>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:46:13 user nova-compute[74507]:       </nova:owner>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:46:13 user nova-compute[74507]:       <nova:ports>
Oct 25 22:46:13 user nova-compute[74507]:         <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:46:13 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:46:13 user nova-compute[74507]:         </nova:port>
Oct 25 22:46:13 user nova-compute[74507]:       </nova:ports>
Oct 25 22:46:13 user nova-compute[74507]:     </nova:instance>
Oct 25 22:46:13 user nova-compute[74507]:   </metadata>
Oct 25 22:46:13 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:46:13 user nova-compute[74507]:     <system>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="serial">05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="uuid">05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:46:13 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:46:13 user nova-compute[74507]:     </system>
Oct 25 22:46:13 user nova-compute[74507]:   </sysinfo>
Oct 25 22:46:13 user nova-compute[74507]:   <os>
Oct 25 22:46:13 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:46:13 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:46:13 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:46:13 user nova-compute[74507]:   </os>
Oct 25 22:46:13 user nova-compute[74507]:   <features>
Oct 25 22:46:13 user nova-compute[74507]:     <acpi/>
Oct 25 22:46:13 user nova-compute[74507]:     <apic/>
Oct 25 22:46:13 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:46:13 user nova-compute[74507]:   </features>
Oct 25 22:46:13 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:46:13 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:46:13 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:46:13 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:46:13 user nova-compute[74507]:   </clock>
Oct 25 22:46:13 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:46:13 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:46:13 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:46:13 user nova-compute[74507]:   </cpu>
Oct 25 22:46:13 user nova-compute[74507]:   <devices>
Oct 25 22:46:13 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:46:13 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:46:13 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk"/>
Oct 25 22:46:13 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:46:13 user nova-compute[74507]:     </disk>
Oct 25 22:46:13 user nova-compute[74507]:     <disk type="file" device="cdrom">
Oct 25 22:46:13 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 22:46:13 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config"/>
Oct 25 22:46:13 user nova-compute[74507]:       <target dev="hda" bus="ide"/>
Oct 25 22:46:13 user nova-compute[74507]:     </disk>
Oct 25 22:46:13 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:46:13 user nova-compute[74507]:       <mac address="fa:16:3e:c9:0d:47"/>
Oct 25 22:46:13 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:13 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:46:13 user nova-compute[74507]:       <target dev="tap5c7f140a-fa"/>
Oct 25 22:46:13 user nova-compute[74507]:     </interface>
Oct 25 22:46:13 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:46:13 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log" append="off"/>
Oct 25 22:46:13 user nova-compute[74507]:     </serial>
Oct 25 22:46:13 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:46:13 user nova-compute[74507]:     <video>
Oct 25 22:46:13 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:13 user nova-compute[74507]:     </video>
Oct 25 22:46:13 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:46:13 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:46:13 user nova-compute[74507]:     </rng>
Oct 25 22:46:13 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:46:13 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:46:13 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:46:13 user nova-compute[74507]:     </memballoon>
Oct 25 22:46:13 user nova-compute[74507]:   </devices>
Oct 25 22:46:13 user nova-compute[74507]: </domain>
Oct 25 22:46:13 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG os_vif [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47ffb1bc-722e-589b-8698-3ef27ab36f13', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c7f140a-fa, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c7f140a-fa, col_values=(('qos', UUID('2c549be0-b069-434f-80b6-e18c85ce74fe')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c7f140a-fa, col_values=(('external_ids', {'iface-id': '5c7f140a-fa7b-4393-95bd-86a33cc31cc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:0d:47', 'vm-uuid': '05535d1f-7a9b-46e6-ba67-4709507a3ee4'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: INFO os_vif [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa')
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Instance spawned successfully.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Took 11.34 seconds to spawn the instance on the hypervisor.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name hda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No VIF found with MAC fa:16:3e:c9:0d:47, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Using config drive
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Took 9.59 seconds to spawn the instance on the hypervisor.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.compute.manager [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Took 12.58 seconds to build instance.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d8510ece-fc0b-4e7b-bb98-5d43eaecfd05 tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.229s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Creating config drive at /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config
Oct 25 22:46:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_y6n2esd {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:13 user nova-compute[74507]: INFO nova.compute.manager [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Took 10.94 seconds to build instance.
Oct 25 22:46:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_y6n2esd" returned: 0 in 0.058s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8bd7c58d-083c-4533-a738-7db415c5a705 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.248s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.neutron [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updated VIF entry in instance network info cache for port 5c7f140a-fa7b-4393-95bd-86a33cc31cc8. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG nova.network.neutron [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28df5d32-ac76-40da-a362-75c669e8ad31 req-19c14a23-4e3a-4b10-b2ba-804faf4c8a78 service nova] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:46:15 user nova-compute[74507]: INFO nova.compute.claims [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Claim successful on node user
Oct 25 22:46:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:15 user nova-compute[74507]: WARNING nova.compute.manager [req-6a819052-833b-4d23-84fb-0ca2082ab489 req-ffa57cd2-c8c1-4cb3-b3dd-ffd5c89df887 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 for instance with vm_state building and task_state spawning.
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:46:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:46:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG nova.policy [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95a93ac4fa554292ad2ad9b3d64c30a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069f799af70c46e98a9d3a17d74d49f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:46:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Creating image(s)
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "/opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "/opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.247s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk 1073741824" returned: 0 in 0.093s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:46:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Successfully created port: 22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Cannot resize image /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Ensure instance console log exists: /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:17 user nova-compute[74507]: WARNING nova.compute.manager [req-fb4a1212-10ba-4030-8d1e-4ffcd0e2a97b req-fd338213-d9cd-4fcd-b05a-f8e82bbcc665 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state None.
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Successfully updated port: 22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquired lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-changed-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Refreshing instance network info cache due to event network-changed-22348a80-cc7e-4f85-b522-8ed4605e6e43. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] Acquiring lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:46:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Instance spawned successfully.
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:17 user nova-compute[74507]: WARNING nova.compute.manager [req-fbf639e9-d5cd-40d6-b014-21ab4f296406 req-53aa8688-c051-410f-8eab-f3ad2576fd51 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 for instance with vm_state building and task_state spawning.
Oct 25 22:46:18 user nova-compute[74507]: INFO nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Took 9.69 seconds to spawn the instance on the hypervisor.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:46:18 user nova-compute[74507]: INFO nova.compute.manager [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Took 10.81 seconds to build instance.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5fae46a5-c27b-4c4b-b102-1421f563e4c7 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.983s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updating instance_info_cache with network_info: [{"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Releasing lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Instance network_info: |[{"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] Acquired lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Refreshing network info cache for port 22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Start _get_guest_xml network_info=[{"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:46:18 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:18 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1772166494',display_name='tempest-VolumesAssistedSnapshotsTest-server-1772166494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1772166494',id=10,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/Hp7lonyK0gNt2qrWVjxD3CaU/OWTLcY1N6SNf5r4BqEwSzHUmLoZfwyNc/Z+EZ3OE52NF8pXsaB03exkyAT3x5cnHOR4as1a2183sih5nWTZvxXYjxvrpXjHk3xiNwg==',key_name='tempest-keypair-814436689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069f799af70c46e98a9d3a17d74d49f3',ramdisk_id='',reservation_id='r-rr7dz74a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1378003740',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1378003740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95a93ac4fa554292ad2ad9b3d64c30a1',uuid=9ee2afc8-b278-4b64-ad08-213cc752a982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converting VIF {"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:46:18 user nova-compute[74507]:   <uuid>9ee2afc8-b278-4b64-ad08-213cc752a982</uuid>
Oct 25 22:46:18 user nova-compute[74507]:   <name>instance-0000000a</name>
Oct 25 22:46:18 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:46:18 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:46:18 user nova-compute[74507]:   <metadata>
Oct 25 22:46:18 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:46:18 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1772166494</nova:name>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:46:18</nova:creationTime>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:46:18 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:46:18 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:owner>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:user uuid="95a93ac4fa554292ad2ad9b3d64c30a1">tempest-VolumesAssistedSnapshotsTest-1378003740-project-member</nova:user>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:project uuid="069f799af70c46e98a9d3a17d74d49f3">tempest-VolumesAssistedSnapshotsTest-1378003740</nova:project>
Oct 25 22:46:18 user nova-compute[74507]:       </nova:owner>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:46:18 user nova-compute[74507]:       <nova:ports>
Oct 25 22:46:18 user nova-compute[74507]:         <nova:port uuid="22348a80-cc7e-4f85-b522-8ed4605e6e43">
Oct 25 22:46:18 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:46:18 user nova-compute[74507]:         </nova:port>
Oct 25 22:46:18 user nova-compute[74507]:       </nova:ports>
Oct 25 22:46:18 user nova-compute[74507]:     </nova:instance>
Oct 25 22:46:18 user nova-compute[74507]:   </metadata>
Oct 25 22:46:18 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:46:18 user nova-compute[74507]:     <system>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="serial">9ee2afc8-b278-4b64-ad08-213cc752a982</entry>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="uuid">9ee2afc8-b278-4b64-ad08-213cc752a982</entry>
Oct 25 22:46:18 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:46:18 user nova-compute[74507]:     </system>
Oct 25 22:46:18 user nova-compute[74507]:   </sysinfo>
Oct 25 22:46:18 user nova-compute[74507]:   <os>
Oct 25 22:46:18 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:46:18 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:46:18 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:46:18 user nova-compute[74507]:   </os>
Oct 25 22:46:18 user nova-compute[74507]:   <features>
Oct 25 22:46:18 user nova-compute[74507]:     <acpi/>
Oct 25 22:46:18 user nova-compute[74507]:     <apic/>
Oct 25 22:46:18 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:46:18 user nova-compute[74507]:   </features>
Oct 25 22:46:18 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:46:18 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:46:18 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:46:18 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:46:18 user nova-compute[74507]:   </clock>
Oct 25 22:46:18 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:46:18 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:46:18 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:46:18 user nova-compute[74507]:   </cpu>
Oct 25 22:46:18 user nova-compute[74507]:   <devices>
Oct 25 22:46:18 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:46:18 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:46:18 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk"/>
Oct 25 22:46:18 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:46:18 user nova-compute[74507]:     </disk>
Oct 25 22:46:18 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:46:18 user nova-compute[74507]:       <mac address="fa:16:3e:96:63:b4"/>
Oct 25 22:46:18 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:18 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:46:18 user nova-compute[74507]:       <target dev="tap22348a80-cc"/>
Oct 25 22:46:18 user nova-compute[74507]:     </interface>
Oct 25 22:46:18 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:46:18 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/console.log" append="off"/>
Oct 25 22:46:18 user nova-compute[74507]:     </serial>
Oct 25 22:46:18 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:46:18 user nova-compute[74507]:     <video>
Oct 25 22:46:18 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:46:18 user nova-compute[74507]:     </video>
Oct 25 22:46:18 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:46:18 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:46:18 user nova-compute[74507]:     </rng>
Oct 25 22:46:18 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:46:18 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:46:18 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:46:18 user nova-compute[74507]:     </memballoon>
Oct 25 22:46:18 user nova-compute[74507]:   </devices>
Oct 25 22:46:18 user nova-compute[74507]: </domain>
Oct 25 22:46:18 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1772166494',display_name='tempest-VolumesAssistedSnapshotsTest-server-1772166494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1772166494',id=10,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/Hp7lonyK0gNt2qrWVjxD3CaU/OWTLcY1N6SNf5r4BqEwSzHUmLoZfwyNc/Z+EZ3OE52NF8pXsaB03exkyAT3x5cnHOR4as1a2183sih5nWTZvxXYjxvrpXjHk3xiNwg==',key_name='tempest-keypair-814436689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069f799af70c46e98a9d3a17d74d49f3',ramdisk_id='',reservation_id='r-rr7dz74a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1378003740',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1378003740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95a93ac4fa554292ad2ad9b3d64c30a1',uuid=9ee2afc8-b278-4b64-ad08-213cc752a982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converting VIF {"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG os_vif [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f8a6b1e-776d-5596-953c-af7e94ee7848', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22348a80-cc, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22348a80-cc, col_values=(('qos', UUID('f1635e05-194b-43ad-a27a-76fcd1d93284')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22348a80-cc, col_values=(('external_ids', {'iface-id': '22348a80-cc7e-4f85-b522-8ed4605e6e43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:63:b4', 'vm-uuid': '9ee2afc8-b278-4b64-ad08-213cc752a982'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:46:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Instance spawned successfully.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:46:18 user nova-compute[74507]: INFO os_vif [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc')
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] No VIF found with MAC fa:16:3e:96:63:b4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:46:18 user nova-compute[74507]: INFO nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Took 9.51 seconds to spawn the instance on the hypervisor.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:46:18 user nova-compute[74507]: INFO nova.compute.manager [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Took 11.06 seconds to build instance.
Oct 25 22:46:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a8d255e9-c6ef-4aab-820b-f6e4967e6f0d tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.201s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.network.neutron [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updated VIF entry in instance network info cache for port 22348a80-cc7e-4f85-b522-8ed4605e6e43. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.network.neutron [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updating instance_info_cache with network_info: [{"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f52bb66-2cd4-4ffd-ad22-5e92a09790c7 req-263aa97d-6545-4eb1-b377-ced40edeccc4 service nova] Releasing lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:19 user nova-compute[74507]: WARNING nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state None.
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:19 user nova-compute[74507]: WARNING nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state None.
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:19 user nova-compute[74507]: WARNING nova.compute.manager [req-f3e0e205-0b55-425d-95a7-acf434b88d07 req-8b2165f9-ace8-4257-ad52-88b070701c3f service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state None.
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:22 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:46:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Instance spawned successfully.
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:46:23 user nova-compute[74507]: INFO nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Took 7.21 seconds to spawn the instance on the hypervisor.
Oct 25 22:46:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:23 user nova-compute[74507]: INFO nova.compute.manager [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Took 8.34 seconds to build instance.
Oct 25 22:46:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9f367d1-f54f-46f5-8091-0bcbe5164173 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.518s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:24 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:46:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:46:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:30 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:30 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:46:30 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.484954833984375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:46:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9ee2afc8-b278-4b64-ad08-213cc752a982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:46:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.157s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:32 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:46:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:46:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:46:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] No waiting events found dispatching network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:36 user nova-compute[74507]: WARNING nova.compute.manager [req-7062420d-4d26-4e64-b93d-fc6e42252242 req-5a1d1d86-adee-4dcc-bd24-9fe4127d5d08 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received unexpected event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b for instance with vm_state active and task_state None.
Oct 25 22:46:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] No waiting events found dispatching network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:38 user nova-compute[74507]: WARNING nova.compute.manager [req-6f514843-07c7-4bca-b099-ae6e99631998 req-084c4fbf-a087-480c-ac9f-6903dc671dc5 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received unexpected event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b for instance with vm_state active and task_state None.
Oct 25 22:46:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] No waiting events found dispatching network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:42 user nova-compute[74507]: WARNING nova.compute.manager [req-0a9240ea-7918-4376-83a6-dcfd55f2efac req-99aca42d-9d8e-4591-80c5-a492ca47887a service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received unexpected event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 for instance with vm_state active and task_state None.
Oct 25 22:46:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] No waiting events found dispatching network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:44 user nova-compute[74507]: WARNING nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received unexpected event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 for instance with vm_state active and task_state None.
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] No waiting events found dispatching network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:44 user nova-compute[74507]: WARNING nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received unexpected event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 for instance with vm_state active and task_state None.
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:46:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] No waiting events found dispatching network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:46:44 user nova-compute[74507]: WARNING nova.compute.manager [req-85c22c6d-a05a-41a6-8ccb-4022369c77b8 req-6670fe54-da79-4dea-8e04-e3ce2c701232 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received unexpected event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 for instance with vm_state active and task_state None.
Oct 25 22:46:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:46:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:47:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:47:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:20 user nova-compute[74507]: INFO nova.compute.manager [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Rescuing
Oct 25 22:47:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:47:21 user nova-compute[74507]: WARNING nova.compute.manager [req-dba274e5-da9e-4517-aeb1-4fab85741bd7 req-080bfb86-da3d-4855-93b8-2683796b842e service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state rescuing.
Oct 25 22:47:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance destroyed successfully.
Oct 25 22:47:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Attempting rescue
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 22:47:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Creating image(s)
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue" returned: 0 in 0.046s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'migration_context' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.base [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<85b692bd-0a00-4dd1-9ce1-cfc0e077818f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start _get_guest_xml network_info=[{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:a1:47:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.base [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<85b692bd-0a00-4dd1-9ce1-cfc0e077818f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.base [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<85b692bd-0a00-4dd1-9ce1-cfc0e077818f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:47:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.base [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<85b692bd-0a00-4dd1-9ce1-cfc0e077818f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-889577759',display_name='tempest-ServerRescueNegativeTestJSON-server-889577759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-889577759',id=2,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-go0dc7hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:42Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=85b692bd-0a00-4dd1-9ce1-cfc0e077818f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:a1:47:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:a1:47:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.objects.base [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<85b692bd-0a00-4dd1-9ce1-cfc0e077818f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:47:21 user nova-compute[74507]:   <uuid>85b692bd-0a00-4dd1-9ce1-cfc0e077818f</uuid>
Oct 25 22:47:21 user nova-compute[74507]:   <name>instance-00000002</name>
Oct 25 22:47:21 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:47:21 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:47:21 user nova-compute[74507]:   <metadata>
Oct 25 22:47:21 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:47:21 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-889577759</nova:name>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:47:21</nova:creationTime>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:47:21 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:47:21 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:owner>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:47:21 user nova-compute[74507]:       </nova:owner>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:47:21 user nova-compute[74507]:       <nova:ports>
Oct 25 22:47:21 user nova-compute[74507]:         <nova:port uuid="591a03ae-3857-490f-8720-e64e5fa6c309">
Oct 25 22:47:21 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:47:21 user nova-compute[74507]:         </nova:port>
Oct 25 22:47:21 user nova-compute[74507]:       </nova:ports>
Oct 25 22:47:21 user nova-compute[74507]:     </nova:instance>
Oct 25 22:47:21 user nova-compute[74507]:   </metadata>
Oct 25 22:47:21 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:47:21 user nova-compute[74507]:     <system>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="serial">85b692bd-0a00-4dd1-9ce1-cfc0e077818f</entry>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="uuid">85b692bd-0a00-4dd1-9ce1-cfc0e077818f</entry>
Oct 25 22:47:21 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:47:21 user nova-compute[74507]:     </system>
Oct 25 22:47:21 user nova-compute[74507]:   </sysinfo>
Oct 25 22:47:21 user nova-compute[74507]:   <os>
Oct 25 22:47:21 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:47:21 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:47:21 user nova-compute[74507]:   </os>
Oct 25 22:47:21 user nova-compute[74507]:   <features>
Oct 25 22:47:21 user nova-compute[74507]:     <acpi/>
Oct 25 22:47:21 user nova-compute[74507]:     <apic/>
Oct 25 22:47:21 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:47:21 user nova-compute[74507]:   </features>
Oct 25 22:47:21 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:47:21 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:47:21 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:47:21 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:47:21 user nova-compute[74507]:   </clock>
Oct 25 22:47:21 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:47:21 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:47:21 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:47:21 user nova-compute[74507]:   </cpu>
Oct 25 22:47:21 user nova-compute[74507]:   <devices>
Oct 25 22:47:21 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:47:21 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:47:21 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue"/>
Oct 25 22:47:21 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:47:21 user nova-compute[74507]:     </disk>
Oct 25 22:47:21 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:47:21 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:47:21 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk"/>
Oct 25 22:47:21 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:47:21 user nova-compute[74507]:     </disk>
Oct 25 22:47:21 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:47:21 user nova-compute[74507]:       <mac address="fa:16:3e:a1:47:5e"/>
Oct 25 22:47:21 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:47:21 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:47:21 user nova-compute[74507]:       <target dev="tap591a03ae-38"/>
Oct 25 22:47:21 user nova-compute[74507]:     </interface>
Oct 25 22:47:21 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:47:21 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/console.log" append="off"/>
Oct 25 22:47:21 user nova-compute[74507]:     </serial>
Oct 25 22:47:21 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:47:21 user nova-compute[74507]:     <video>
Oct 25 22:47:21 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:47:21 user nova-compute[74507]:     </video>
Oct 25 22:47:21 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:47:21 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:47:21 user nova-compute[74507]:     </rng>
Oct 25 22:47:21 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:47:21 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:47:21 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:47:21 user nova-compute[74507]:     </memballoon>
Oct 25 22:47:21 user nova-compute[74507]:   </devices>
Oct 25 22:47:21 user nova-compute[74507]: </domain>
Oct 25 22:47:21 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:47:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance destroyed successfully.
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:47:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:a1:47:5e, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:47:23 user nova-compute[74507]: WARNING nova.compute.manager [req-853fb726-082a-41b0-b93f-4d5e28dd77c9 req-57101b3c-a5ce-44b5-b5b7-c89b8f9be9f7 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state rescuing.
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:47:23 user nova-compute[74507]: INFO nova.compute.claims [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Claim successful on node user
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:47:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:47:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:47:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:47:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:47:24 user nova-compute[74507]: INFO nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Booting with volume 05ec9b82-174a-427b-8fd5-d547c48a7361 at /dev/vda
Oct 25 22:47:24 user nova-compute[74507]: DEBUG nova.policy [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e265c175d7422384c48db8e4d2fb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d482f428b6d49e0b2af74845e86d783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:47:24 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:24 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4xdr_i2r/privsep.sock']
Oct 25 22:47:24 user sudo[86025]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4xdr_i2r/privsep.sock
Oct 25 22:47:24 user sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 22:47:24 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:24 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully created port: 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:47:25 user nova-compute[74507]: WARNING nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state rescuing.
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:47:25 user nova-compute[74507]: WARNING nova.compute.manager [req-64c7c39a-47ec-4762-a4d1-e2b771e6c44e req-70f7b6e7-e683-4a9a-bad8-9b741126071b service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state active and task_state rescuing.
Oct 25 22:47:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f2c4a675-e87e-4966-905c-c70722ed2f0a tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully created port: ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:47:25 user sudo[86025]: pam_unix(sudo:session): session closed for user root
Oct 25 22:47:25 user nova-compute[74507]: INFO oslo.privsep.daemon [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Spawned new privsep daemon via rootwrap
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:47:25 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 22:47:25 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 22:47:25 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 25 22:47:25 user nova-compute[74507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86030
Oct 25 22:47:25 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ca059-6cd6-4ebf-8c2a-4f8dfbf6e87b]: (2,) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully created port: 7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c763c0b-f7bd-4489-9bf1-67a5346dd6b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:26 user nova-compute[74507]: WARNING os_brick.initiator.connectors.nvmeof [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd340f2-5d01-40b6-b215-6a52f2d04419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ed9ac-f0e2-4675-83b6-0a3bf3036a0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf813988-de5d-46f1-a22c-ae5934d8eca3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:26 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3db82d9-bad2-496c-b960-09ef4212e5ec]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== get_connector_properties: return (1954ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating existing volume attachment record: fd55efc2-07b6-4a0c-8792-d1b7d329f208 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully created port: b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully created port: 97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e632a0d-988a-42bc-968a-c193a7991971 req-06215ba2-97b2-45b7-8456-abf023092102 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: 782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing instance network info cache due to event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing network info cache for port a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-782dad1b-229f-4bd4-9a28-fb348bfc801a. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port 782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updated VIF entry in instance network info cache for port a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e33e908a-2613-485c-8e77-47d6a3c1b2f3 req-7a2d49a5-2acc-476d-9bd3-92df7116ddb1 service nova] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-fec4791d-ab24-4c6f-a396-d18f8197bc9e. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-ff0dfd8b-a746-44a4-9eea-df1f71183130. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: 7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:31 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:47:31 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:47:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7179MB free_disk=25.36026382446289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-changed-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Refreshing instance network info cache due to event network-changed-41549664-f691-487a-b621-4498583fbb63. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Refreshing network info cache for port 41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f960ffb-08fa-4d1f-b2e8-808504fdd9db req-54150646-4115-4c49-926b-db68b3e0dbc7 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port 7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9ee2afc8-b278-4b64-ad08-213cc752a982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 12340c14-7420-436a-957e-a7570a6ffadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-changed-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Refreshing instance network info cache due to event network-changed-76e79bc5-6314-4fde-bb5e-9541d1a48274. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Refreshing network info cache for port 76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfee6e27-1043-4587-a3b7-98b75e618d4b req-4e9f6399-92c4-4641-b173-1c485e88d5b9 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updated VIF entry in instance network info cache for port 41549664-f691-487a-b621-4498583fbb63. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-788de4e0-8834-4398-9d99-c37141867d28 req-e7ec81e0-e69b-47c2-aa85-b8e3d6c66242 service nova] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updated VIF entry in instance network info cache for port 76e79bc5-6314-4fde-bb5e-9541d1a48274. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-42d0e42e-b038-4f29-8e24-db70a1331a39 req-8cb2faa9-1b3a-4891-9fa1-e38be58bdf9b service nova] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Successfully updated port: 97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:47:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-b02f9395-653f-453f-ba8a-e4e184646b1e. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance network_info: |[{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updated VIF entry in instance network info cache for port b02f9395-653f-453f-ba8a-e4e184646b1e. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-97569942-737f-4bcf-88e4-d2078ec77c34. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port 97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:36 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updated VIF entry in instance network info cache for port 97569942-737f-4bcf-88e4-d2078ec77c34. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:36 user nova-compute[74507]: DEBUG nova.network.neutron [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bde23b54-93db-47b0-beeb-61192957d1cc req-7510677c-7a94-4a33-8163-ac20b404bcc8 service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:38 user nova-compute[74507]: INFO nova.compute.manager [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Attaching volume 52746134-dd2f-4e6b-9b5f-8262ba49c8fa to /dev/vdb
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.utils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64058680-f7d0-47b0-a4f9-85dc97e24672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03afa6-654e-4068-adb7-1e823255cccb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[972aee0c-8e02-4999-9b53-87a12b1c6ac4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6b73a-2bc7-4314-8f6b-b7fdd230b522]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:38 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:47:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7dbd94-2e29-487e-baca-40db5f9ba92d]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG os_brick.utils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:38 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating existing volume attachment record: 77b2db78-fc84-4a14-bd0c-089345ecf77b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:47:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:45 user nova-compute[74507]: INFO nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Booting with volume 22fd7c60-6039-4867-8c93-12c01a712b9c at /dev/vdb
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40907f-9221-4a1f-8bd2-827e44aadc92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd1a45-d441-468e-aa6d-c95ab180c739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[134806cb-c0b5-4bbc-a43c-b4275343c6a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa512ce9-9c79-4223-958c-17d22aea6036]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:45 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:47:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d744759-bf5a-42d4-a3b8-d5e1105ed656]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:45 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating existing volume attachment record: a443312a-28fe-4bcc-91a9-35f2a8bb05b2 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:47:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-changed-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Refreshing instance network info cache due to event network-changed-614047c4-9225-41e2-b4d7-148df5858276. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] Acquiring lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] Acquired lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:51 user nova-compute[74507]: DEBUG nova.network.neutron [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Refreshing network info cache for port 614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updated VIF entry in instance network info cache for port 614047c4-9225-41e2-b4d7-148df5858276. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating instance_info_cache with network_info: [{"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9756699-a6b8-4e75-be82-8e6a99a686e5 req-4203c634-d7a4-40f3-87cb-ba86f89c5149 service nova] Releasing lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-changed-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Refreshing instance network info cache due to event network-changed-6e7b60f6-5aca-406d-a0b7-4448c01bb558. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] Acquiring lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] Acquired lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG nova.network.neutron [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Refreshing network info cache for port 6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:54 user nova-compute[74507]: DEBUG nova.network.neutron [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updated VIF entry in instance network info cache for port 6e7b60f6-5aca-406d-a0b7-4448c01bb558. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:54 user nova-compute[74507]: DEBUG nova.network.neutron [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updating instance_info_cache with network_info: [{"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f76b0e3a-7ee4-4237-9617-ca21480dce43 req-df6a9c7d-0d26-46de-8b55-02d5de5452f5 service nova] Releasing lock "refresh_cache-c5fd8bd5-777f-4469-a2fb-34af2f2e2097" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-changed-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Refreshing instance network info cache due to event network-changed-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] Acquiring lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] Acquired lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:57 user nova-compute[74507]: DEBUG nova.network.neutron [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Refreshing network info cache for port 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'flavor' on Instance uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lazy-loading 'flavor' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connector [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Factory for ISCSI on None {{(pid=74507) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:47:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:47:58 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9817b7-343e-4cdb-a8e1-ff400044df01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:47:58 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:58 user nova-compute[74507]: INFO nova.compute.manager [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Attaching volume 2c07b781-a189-4d80-b381-82fcc53094a7 to /dev/vdb
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5707442b-4c73-4a5d-9a35-e7b08af967f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa] added
Oct 25 22:47:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[682cc0fa-e737-4834-ae25-b61fc276a1ae]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ebacc-969b-4f71-add9-d4e5bbbcfd8c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrTNJdOs {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrTNJdOs" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a792c7-e890-4381-8921-70996f25e72a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrTNJdOs'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updated VIF entry in instance network info cache for port 0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updating instance_info_cache with network_info: [{"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c1f7c2-999a-4d2d-8c1f-61306b7e45d5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[de804ead-61fb-4320-bf51-caa4b09fb83f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d31a76b8-6ed7-4b71-834b-0c926ac0f44a req-d68d771a-9e0d-499e-a44d-d5414d089cae service nova] Releasing lock "refresh_cache-2db7899e-3a31-4fd6-aece-6cf9b669c96b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdadc8e-e44f-4528-b7fa-c6485f5d8c60]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:47:58 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:47:58 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:47:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:47:58 user nova-compute[74507]: 
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[399ca9d4-e1d4-4de5-a9aa-b9bee922882d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86b029-d93f-43cd-b453-db4bd718ce49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef401098-1b3c-4393-9719-999d245c9d64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19e87a-97ec-490f-8443-841ff44f1a30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]
Oct 25 22:47:58 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.
Oct 25 22:47:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:58 user nova-compute[74507]: INFO nova.compute.manager [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attaching volume ee9806f9-4d2c-4681-9b2a-a07945b0e837 to /dev/vdb
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:58 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bcd99-6e82-43a6-92d8-efdc4c348f80]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating existing volume attachment record: 27f83cd1-89a9-4326-9801-a37bd0aafa53 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6663bd-1db0-4ea0-ad53-300e28a354b8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb0cb59-ccb7-4b90-b5e0-a6cc16d7886a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:47:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:47:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.040s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe033b50-27ee-459d-b8e9-74b0dba62a2c]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce7f50-a9b2-46ec-9f9a-86384f7e4006]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4dd9e3-a1a6-4a35-8dda-6cedc97e3de5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3de757-2875-4e8c-b394-dc457a90d62d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029fc87-38c8-4cdb-9788-44acd299b1a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:47:58 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:47:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac48b7-e164-43a5-af69-71a89a4a982c]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:58 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updating existing volume attachment record: 8fe7f56a-a66b-48bd-b6d3-1cf3b9ac47d1 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-changed-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing instance network info cache due to event network-changed-5c7f140a-fa7b-4393-95bd-86a33cc31cc8. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing network info cache for port 5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updated VIF entry in instance network info cache for port 5c7f140a-fa7b-4393-95bd-86a33cc31cc8. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b850a579-5ece-49c9-81b0-4b350501cd79 req-4cf6d88f-3212-454b-b5d8-2e9e844b7d15 service nova] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23130393063323633', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393063323633', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'pci_requests' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.objects.base [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Object Instance<05535d1f-7a9b-46e6-ba67-4709507a3ee4> lazy-loaded attributes: flavor,pci_requests {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:47:59 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:47:59 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 22:47:59 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:47:59 user nova-compute[74507]:   <serial>52746134-dd2f-4e6b-9b5f-8262ba49c8fa</serial>
Oct 25 22:47:59 user nova-compute[74507]: </disk>
Oct 25 22:47:59 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:47:59 user nova-compute[74507]: DEBUG nova.policy [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd641f86e0cb84147bfa1be85f62dcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344fd16a6c1b439b8e1699dba8d809d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:48:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Successfully created port: 50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:48:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No VIF found with MAC fa:16:3e:e7:ff:6d, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Successfully updated port: 50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-changed-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing instance network info cache due to event network-changed-50722c3b-5921-4cb9-ad90-e07a8d534500. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Refreshing network info cache for port 50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG os_vif [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce8164eb-4f70-5a1b-a5ed-a66988bd4124', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50722c3b-59, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50722c3b-59, col_values=(('qos', UUID('6a70a163-aece-496a-91fa-859b458bffda')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50722c3b-59, col_values=(('external_ids', {'iface-id': '50722c3b-5921-4cb9-ad90-e07a8d534500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:94:e2', 'vm-uuid': '05535d1f-7a9b-46e6-ba67-4709507a3ee4'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: INFO os_vif [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59')
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] attach device xml: <interface type="ethernet">
Oct 25 22:48:01 user nova-compute[74507]:   <mac address="fa:16:3e:fc:94:e2"/>
Oct 25 22:48:01 user nova-compute[74507]:   <model type="virtio"/>
Oct 25 22:48:01 user nova-compute[74507]:   <mtu size="1442"/>
Oct 25 22:48:01 user nova-compute[74507]:   <target dev="tap50722c3b-59"/>
Oct 25 22:48:01 user nova-compute[74507]: </interface>
Oct 25 22:48:01 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:02 user nova-compute[74507]: WARNING nova.compute.manager [req-1fdd9981-d68b-468c-8b72-dc855971b3fc req-dd29e7f4-93fc-4d9c-b41e-290d0126b963 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 for instance with vm_state active and task_state None.
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updated VIF entry in instance network info cache for port 50722c3b-5921-4cb9-ad90-e07a8d534500. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e2e2a837-a45a-4b5d-b5e6-f2c63cfc0c21 req-2fe05ad7-6a62-413b-8b66-faef403f98eb service nova] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name hda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No VIF found with MAC fa:16:3e:c9:0d:47, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:48:02 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:48:02</nova:creationTime>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:48:02 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:48:02 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:owner>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:48:02 user nova-compute[74507]:   </nova:owner>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:48:02 user nova-compute[74507]:   <nova:ports>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:48:02 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:48:02 user nova-compute[74507]:     </nova:port>
Oct 25 22:48:02 user nova-compute[74507]:     <nova:port uuid="50722c3b-5921-4cb9-ad90-e07a8d534500">
Oct 25 22:48:02 user nova-compute[74507]:       <nova:ip type="fixed" address="10.10.10.108" ipVersion="4"/>
Oct 25 22:48:02 user nova-compute[74507]:     </nova:port>
Oct 25 22:48:02 user nova-compute[74507]:   </nova:ports>
Oct 25 22:48:02 user nova-compute[74507]: </nova:instance>
Oct 25 22:48:02 user nova-compute[74507]:  {{(pid=74507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c530755a-bccc-40ef-9f00-4cd02126a537 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.777s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:04 user nova-compute[74507]: WARNING nova.compute.manager [req-dce79194-1255-4fc2-abff-51bb9ca5235f req-d202943b-7c27-4a27-a536-539036bc6446 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 for instance with vm_state active and task_state None.
Oct 25 22:48:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-changed-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Refreshing instance network info cache due to event network-changed-22348a80-cc7e-4f85-b522-8ed4605e6e43. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:48:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] Acquiring lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:48:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] Acquired lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:48:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Refreshing network info cache for port 22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:48:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updated VIF entry in instance network info cache for port 22348a80-cc7e-4f85-b522-8ed4605e6e43. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:48:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updating instance_info_cache with network_info: [{"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:48:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7de24744-3319-4389-8a96-8203194e7602 req-a73fd545-55ec-463e-a1ca-9add2c42e926 service nova] Releasing lock "refresh_cache-9ee2afc8-b278-4b64-ad08-213cc752a982" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:48:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-57e0dd59-751e-46f1-b98c-72f2f92212b0 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.452s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lazy-loading 'flavor' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:09 user nova-compute[74507]: INFO nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Booting with volume 9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef at /dev/vdc
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lazy-loading 'flavor' on Instance uuid c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:09 user nova-compute[74507]: INFO nova.compute.manager [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Attaching volume b16dc717-9afa-4f80-854c-92eab7ee09e0 to /dev/vdb
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:10 user nova-compute[74507]: INFO nova.compute.manager [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Attaching volume 0860d512-8b03-4b9f-b4eb-41299e835f95 to /dev/vdb
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3177f40c-fd5b-4352-87a3-860c548b4332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5807d-e5a5-4b21-a78d-a642f312a693]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ce572d-842e-4918-9192-a9f6a943d29b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f1807-2103-4eb6-a8b9-be462d376a21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:10 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b320e085-0b76-416e-a63d-602f972653d5]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG os_brick.utils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating existing volume attachment record: e195b7c3-ab2e-4d85-9df8-ab8ad58a727e {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:10 user nova-compute[74507]: INFO nova.compute.manager [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Attaching volume 020146d1-0dbe-4475-a4f8-d442867c072f to /dev/sdc
Oct 25 22:48:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDWGRkZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:17 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:17 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:17 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[361cf08c-ce19-40e7-880e-21c20c5948bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:18 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[243d4083-1820-4144-b96b-63f003c901c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7] added
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa3e4db-bd6f-4b1f-8597-f08cb2fd7634]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daefde0-03f9-453d-8a48-63b659f8cf20]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDWGRkZN {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VDWGRkZN" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7862e7b-e6fe-4655-891b-adf9d5016619]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VDWGRkZN'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc5e56-eeec-4f9d-977e-3aa19c44d294]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3fae8-1424-43de-93d7-1e8358e44825]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[92221c1d-4f84-43d7-818f-99b54f170d8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e6678c-86f4-4204-bf29-ecbe27dadaea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aeb109-f756-4c28-876d-53652f3d8a4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da80d1e-5469-4a28-ac55-b2701b5de8eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6034d19b-d885-407f-b700-8262fd7bcebe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f881b8a8-73a7-4762-bc1f-ccee02106f38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05baa89-8b07-42d7-b891-0cebf91b1a74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331c2c6-d630-41da-9bb9-ec9a5e403fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9c465-d69f-44fe-b8e1-8625a05f890b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b21c4d4-226a-444f-ba3b-2b18a137da9b]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260]
Oct 25 22:48:18 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating existing volume attachment record: b9686232-0ee6-4fe1-b0fd-4832a636dda9 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e387baba-54a8-43d1-ad81-aaffbacc7fdd]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updating existing volume attachment record: 352ab295-a660-4529-bed8-9662d4672f55 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d59be1-320b-4faa-85a3-d94075dd240b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1fec6-b1c3-415d-b40e-9e66fffbc577]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:18 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:18 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11626842-16a8-4022-8524-17c6263ca240]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDWGRkZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74507) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21f740-b899-419e-9a1a-22093d73b4ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f723a57-0e78-427f-aed6-d40e062aca1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a30f6-d4e2-4844-a629-2a14a03e122a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e26fa4-1d64-4da6-ba22-3071cba404c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:18 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbb4798-7c2e-45b1-8532-6027241c1ccb]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG os_brick.utils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updating existing volume attachment record: 11526127-d412-4008-9e88-343162450a31 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:18 user nova-compute[74507]: WARNING nova.compute.manager [req-0f57889b-6f03-4e16-ba94-50725638a857 req-4d0e0ae9-bb59-4ba6-abb6-3be937d2b359 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state active and task_state powering-off.
Oct 25 22:48:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance destroyed successfully.
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26664616563626335', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664616563626335', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.950s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:19 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'flavor' on Instance uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fa54b-e312-4d50-8d33-522addadb09d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:19 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:48:19 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:19 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:48:19 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:19 user nova-compute[74507]:   <serial>2c07b781-a189-4d80-b381-82fcc53094a7</serial>
Oct 25 22:48:19 user nova-compute[74507]: </disk>
Oct 25 22:48:19 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27819d3d-ae9c-48a7-b603-5021322abbc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837] added
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b094fdc5-67b6-46cf-ae6f-ac41427c6a84]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-457e5ccd-9001-41cd-955f-3143035162a5 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.097s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb93e7-a66b-49a3-9443-5a9d0fea832e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utJykYhV {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utJykYhV" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcf9649-4097-4ad3-8573-b7f83557e7b0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utJykYhV'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e0341b-4339-4df4-9269-abce75c48954]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d41bc9-8770-4718-8b22-151ea7a8db8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0453de-092f-4dcb-ab86-bb48ff8c5942]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]
Oct 25 22:48:19 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ca0c10-8e96-4544-bcd4-0bb9e9607258]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d7d9c-85f5-4ce2-9d8e-398f55a0c2ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3773b9-66cc-449c-aeaf-5ff607fab552]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No VIF found with MAC fa:16:3e:48:b1:58, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] <== connect_volume: return (2300ms) {'type': 'block', 'scsi_wwn': '23861616430313137', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861616430313137', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lazy-loading 'flavor' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:48:20 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:20 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:48:20 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:20 user nova-compute[74507]:   <serial>ee9806f9-4d2c-4681-9b2a-a07945b0e837</serial>
Oct 25 22:48:20 user nova-compute[74507]: </disk>
Oct 25 22:48:20 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:20 user nova-compute[74507]: WARNING nova.compute.manager [req-f4a75cb3-133b-4fce-a0a6-d5f7cc11eed1 req-638d7712-9fd8-49ca-a664-d180e440a871 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state None.
Oct 25 22:48:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] No VIF found with MAC fa:16:3e:3a:ae:5c, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:24 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:48:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:48:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:48:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:32 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:48:32 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7210MB free_disk=25.34680938720703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9ee2afc8-b278-4b64-ad08-213cc752a982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 12340c14-7420-436a-957e-a7570a6ffadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:48:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:48:33 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:48:33 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:48:33 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:48:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:48:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrpPDfVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:38 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:38 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:38 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a656f3-86db-4e68-b7c8-09fcc8dce854]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:38 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef001e-cd4c-4a87-b23e-54dbfac23ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0] added
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b0a5f-1ffd-4f19-9626-b2fd7af9e50d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIyULpVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:38 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad9724-7b96-4e79-87e3-3e5aa89914a1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrpPDfVG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrpPDfVG" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de3617c-4082-4d1e-94c4-8709897f2413]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrpPDfVG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c284b-9b64-4a72-aadc-b8571c0b9ab6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad75dc45-b8c7-4bf3-868f-4a0cd59912e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[067aae94-25ff-426b-a36b-799bc0c1e00f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260]
Oct 25 22:48:38 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2db3e702-1429-4778-9ff2-5a737fe74a4e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.310s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f4ae0eec-899f-4104-b797-bc513df22e0b tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.047s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea418077-3730-45a5-886f-3d291b3bbe8a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d3fac5-195a-4d7e-a788-5362686fa5f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[81915450-64fc-4f82-be99-73bfd3609ee0]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:48:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Creating image(s)
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Ensure instance console log exists: /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Start _get_guest_xml network_info=[{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fd55efc2-07b6-4a0c-8792-d1b7d329f208', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxoAitDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12340c14-7420-436a-957e-a7570a6ffadc', 'attached_at': '', 'detached_at': '', 'volume_id': '05ec9b82-174a-427b-8fd5-d547c48a7361', 'serial': '05ec9b82-174a-427b-8fd5-d547c48a7361'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'a443312a-28fe-4bcc-91a9-35f2a8bb05b2', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhmgbFjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12340c14-7420-436a-957e-a7570a6ffadc', 'attached_at': '', 'detached_at': '', 'volume_id': '22fd7c60-6039-4867-8c93-12c01a712b9c', 'serial': '22fd7c60-6039-4867-8c93-12c01a712b9c'}, 'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'e195b7c3-ab2e-4d85-9df8-ab8ad58a727e', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbsmDBaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12340c14-7420-436a-957e-a7570a6ffadc', 'attached_at': '', 'detached_at': '', 'volume_id': '9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 'serial': '9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef'}, 'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrpPDfVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.629s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] <== connect_volume: return (631ms) {'type': 'block', 'scsi_wwn': '23833353838336238', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833353838336238', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.554s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:39 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:48:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxoAitDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35abae5-4e96-4cc8-aa99-533777ff5ff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:39 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:48:39 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:39 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:48:39 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:39 user nova-compute[74507]:   <serial>b16dc717-9afa-4f80-854c-92eab7ee09e0</serial>
Oct 25 22:48:39 user nova-compute[74507]: </disk>
Oct 25 22:48:39 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[580dae7f-8fdd-45d2-a3de-0c1c650bfa44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95] added
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d52c9-093f-47b7-9bc9-e8d0bc60892b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f383e9e4-b979-4760-87a6-b7b9b11a41f8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIyULpVB {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIyULpVB" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82448d9-6f8b-4e98-80d0-05b476b87d7a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uIyULpVB'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916dabe-93f0-452b-9137-d62770022ce5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47011048-facb-42ec-b2e3-0f4c7d773f87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea9c26-59ad-4260-a364-594ff5e71b1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260]
Oct 25 22:48:39 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3fb418-c7c6-452d-a5b6-0f6a6f5f6838]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8d817-dd90-40a2-9e6d-da6936874a84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e4750-75a5-427b-8627-6c028cbd2ff9]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIyULpVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No BDM found with device name hda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] No VIF found with MAC fa:16:3e:c9:0d:47, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9af339dd-9a69-4908-8620-055f4a46fe50 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.785s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.utils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] <== connect_volume: return (1909ms) {'type': 'block', 'scsi_wwn': '26664633862303962', 'path': '/dev/sdf'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664633862303962', 'path': '/dev/sdf'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.306s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:40 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:40 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lazy-loading 'flavor' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fefb7e-8ba6-4606-8ca1-53d160a79ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcda8f-6c8f-4436-9d1c-4472e6d3ee10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:40 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e70740-f798-4fda-8535-bdb1b98aa6f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf35b97-3151-402b-874c-3408032fddbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361] added
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f778952-5b57-4a13-a85b-4556205bfe87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] attach device xml: <disk type="block" device="disk">
Oct 25 22:48:40 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:40 user nova-compute[74507]:   <source dev="/dev/sdf"/>
Oct 25 22:48:40 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:40 user nova-compute[74507]:   <serial>0860d512-8b03-4b9f-b4eb-41299e835f95</serial>
Oct 25 22:48:40 user nova-compute[74507]: </disk>
Oct 25 22:48:40 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[55991f9a-b46c-40f7-8deb-8fa9c3cb2459]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3065b422-d978-4f4f-a2f7-d73e37241853]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: INFO nova.compute.manager [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Detaching volume 2c07b781-a189-4d80-b381-82fcc53094a7
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:48:40 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c45ce5-4e82-46fa-aea9-f75be5053d80]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.utils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad8b13-3fda-4408-98a3-ac48044e83e7]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxoAitDL {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxoAitDL" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a9fd4e-d9d0-447c-b2e1-c4bfe2a1f65d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxoAitDL'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62bbb0-3ecb-4fbf-b444-a4c92d43cec8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: INFO nova.virt.block_device [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Attempting to driver detach volume 2c07b781-a189-4d80-b381-82fcc53094a7 from mountpoint /dev/vdb
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482cd92-002e-48ee-89ea-c73449e9cde7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Attempting to detach device vdb from instance a24bc0e5-a941-49ce-b5f4-36308b71620c from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:40 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:40 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:48:40 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:40 user nova-compute[74507]:   <serial>2c07b781-a189-4d80-b381-82fcc53094a7</serial>
Oct 25 22:48:40 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:48:40 user nova-compute[74507]: </disk>
Oct 25 22:48:40 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully detached device vdb from instance a24bc0e5-a941-49ce-b5f4-36308b71620c from the persistent domain config.
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a24bc0e5-a941-49ce-b5f4-36308b71620c from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:40 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:40 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:48:40 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:40 user nova-compute[74507]:   <serial>2c07b781-a189-4d80-b381-82fcc53094a7</serial>
Oct 25 22:48:40 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:48:40 user nova-compute[74507]: </disk>
Oct 25 22:48:40 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:40 user nova-compute[74507]: INFO nova.compute.manager [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Swapping volume ee9806f9-4d2c-4681-9b2a-a07945b0e837 for 47091bba-a724-4790-af09-7c8e8211cf8b
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09961ee-d620-4936-9dfd-96c29e112de7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260]
Oct 25 22:48:40 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5dda3-1ffd-4868-8ebc-03ac3eab9a04]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d6dace-64fd-4651-b1b0-c9b5bb2da229]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6025135e-3cb4-4dc6-927b-b02617de3788]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxoAitDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] No VIF found with MAC fa:16:3e:96:63:b4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97b8d1d7-a09e-474f-8cab-e9c863ffa6cd tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.112s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:41 user nova-compute[74507]: INFO nova.compute.manager [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Detaching volume b16dc717-9afa-4f80-854c-92eab7ee09e0
Oct 25 22:48:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:41 user nova-compute[74507]: INFO nova.virt.block_device [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Attempting to driver detach volume b16dc717-9afa-4f80-854c-92eab7ee09e0 from mountpoint /dev/vdb
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Attempting to detach device vdb from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:41 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:41 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:48:41 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:41 user nova-compute[74507]:   <serial>b16dc717-9afa-4f80-854c-92eab7ee09e0</serial>
Oct 25 22:48:41 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 22:48:41 user nova-compute[74507]: </disk>
Oct 25 22:48:41 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== connect_volume: return (2766ms) {'type': 'block', 'scsi_wwn': '23836616632323863', 'path': '/dev/sdg'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836616632323863', 'path': '/dev/sdg'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully detached device vdb from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the persistent domain config.
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:41 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:41 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:48:41 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:41 user nova-compute[74507]:   <serial>b16dc717-9afa-4f80-854c-92eab7ee09e0</serial>
Oct 25 22:48:41 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 22:48:41 user nova-compute[74507]: </disk>
Oct 25 22:48:41 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhmgbFjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:41 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:41 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:41 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275dbca-a623-4915-82d0-9fb3dc57e78a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:41 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03fbff4-d841-4047-a1f3-92570502df4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c] added
Oct 25 22:48:41 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8b40f-ae15-46c8-870b-9bda6edcdfa8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edab8a4-d4f9-47e1-85c7-30bcc46341ea]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhmgbFjl {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhmgbFjl" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc6e959-d9c9-40e0-8880-83b0c31c2c50]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OhmgbFjl'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b15ae38-be01-4b43-a4bb-184880e1fb42]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14145df-729a-4dcb-b269-9f5c6038d241]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] volume_snapshot_create: create_info: {'snapshot_id': '4e9856f2-c6c9-4a84-ad2a-b437207bcbea', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74507) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] snap xml: <domainsnapshot>
Oct 25 22:48:42 user nova-compute[74507]:   <disks>
Oct 25 22:48:42 user nova-compute[74507]:     <disk name="/dev/sdf" snapshot="external" type="file">
Oct 25 22:48:42 user nova-compute[74507]:       <source file="/dev/new_file"/>
Oct 25 22:48:42 user nova-compute[74507]:     </disk>
Oct 25 22:48:42 user nova-compute[74507]:     <disk name="vda" snapshot="no"/>
Oct 25 22:48:42 user nova-compute[74507]:   </disks>
Oct 25 22:48:42 user nova-compute[74507]: </domainsnapshot>
Oct 25 22:48:42 user nova-compute[74507]:  {{(pid=74507) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] Lazy-loading 'system_metadata' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c3bd35-dbe5-4765-805a-fda2b4aba3e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260]
Oct 25 22:48:42 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970cb73-49fe-4b29-abd9-a8d720f3992a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d3180d-fcf8-4690-8123-d3d3904efe8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:42 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     rv = execute(f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     six.reraise(c, e, tb)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     raise value
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     rv = meth(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     self._volume_snapshot_create(context, instance, guest,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     rv = execute(f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     six.reraise(c, e, tb)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     raise value
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     rv = meth(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] 
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e457de44-2786-490c-a363-c8933f36fe5e]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhmgbFjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f488a46e-6a8e-425d-adb7-0d46f52721a6 tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] volume_snapshot_delete: delete_info: {'volume_id': '0860d512-8b03-4b9f-b4eb-41299e835f95'} {{(pid=74507) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [None req-f488a46e-6a8e-425d-adb7-0d46f52721a6 tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982]     if delete_info['type'] != 'qcow2':
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] KeyError: 'type'
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4e9856f2-c6c9-4a84-ad2a-b437207bcbea could not be found.
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise value
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4e9856f2-c6c9-4a84-ad2a-b437207bcbea could not be found. (HTTP 404) (Request-ID: req-fcc2316b-6d79-4a9d-bf85-16acdc5fd6c6)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4e9856f2-c6c9-4a84-ad2a-b437207bcbea could not be found.
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server [None req-a8fa2ec6-1048-40d8-9258-871e50866dbd tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise value
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver [None req-f488a46e-6a8e-425d-adb7-0d46f52721a6 tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-16a84a4e-d135-40ee-abac-30a4a484d0f7)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 22:48:42 user nova-compute[74507]: ERROR nova.virt.libvirt.driver 
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server [None req-f488a46e-6a8e-425d-adb7-0d46f52721a6 tempest-VolumesAssistedSnapshotsTest-1493374702 tempest-VolumesAssistedSnapshotsTest-1493374702-project] Exception during message handling: KeyError: 'type'
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 25 22:48:42 user nova-compute[74507]: ERROR oslo_messaging.rpc.server 
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:42 user nova-compute[74507]: INFO nova.compute.manager [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Detaching volume 0860d512-8b03-4b9f-b4eb-41299e835f95
Oct 25 22:48:42 user nova-compute[74507]: INFO nova.virt.block_device [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Attempting to driver detach volume 0860d512-8b03-4b9f-b4eb-41299e835f95 from mountpoint /dev/vdb
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Attempting to detach device vdb from instance 9ee2afc8-b278-4b64-ad08-213cc752a982 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:42 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:42 user nova-compute[74507]:   <source dev="/dev/sdf"/>
Oct 25 22:48:42 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:42 user nova-compute[74507]:   <serial>0860d512-8b03-4b9f-b4eb-41299e835f95</serial>
Oct 25 22:48:42 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:48:42 user nova-compute[74507]: </disk>
Oct 25 22:48:42 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:42 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Successfully detached device vdb from instance 9ee2afc8-b278-4b64-ad08-213cc752a982 from the persistent domain config.
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ee2afc8-b278-4b64-ad08-213cc752a982 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:48:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 22:48:42 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:42 user nova-compute[74507]:   <source dev="/dev/sdf"/>
Oct 25 22:48:42 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:48:42 user nova-compute[74507]:   <serial>0860d512-8b03-4b9f-b4eb-41299e835f95</serial>
Oct 25 22:48:42 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:48:42 user nova-compute[74507]: </disk>
Oct 25 22:48:42 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23966633137666435', 'path': '/dev/sdh'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966633137666435', 'path': '/dev/sdh'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbsmDBaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:48:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:48:43 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[951270a7-82a7-4933-9fce-78307dbaefd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:48:43 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b1ece9-83e3-4f31-8b14-54e67e1247e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef] added
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4079e829-f655-4919-8c09-768a259a2cbc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb3ed2a-aa0e-424e-8e1f-1e8f3c1bb178]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbsmDBaW {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbsmDBaW" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44459ac-503d-497f-8512-d63bc6d566d3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbsmDBaW'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf08089-d9bd-4b71-a2ba-ee1ce4d31b92]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c6923e-2569-4ad4-867a-3ef75a091c74]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15434c49-ca74-4d9c-876f-52a5fbc5fe40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260]
Oct 25 22:48:43 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260] successful.
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbc85d-1950-4e77-8e75-13dc36b951a0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6881f5-200d-4c19-89fb-0d17023e73d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:48:43 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:48:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fcea0f-ccc5-4150-803d-29fce3ef49d2]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:48:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbsmDBaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26438643665356261', 'path': '/dev/sdi'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643665356261', 'path': '/dev/sdi'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lazy-loading 'pci_devices' on Instance uuid 12340c14-7420-436a-957e-a7570a6ffadc {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:48:44 user nova-compute[74507]:   <uuid>12340c14-7420-436a-957e-a7570a6ffadc</uuid>
Oct 25 22:48:44 user nova-compute[74507]:   <name>instance-0000000b</name>
Oct 25 22:48:44 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:48:44 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:48:44 user nova-compute[74507]:   <metadata>
Oct 25 22:48:44 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:48:44 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:name>tempest-device-tagging-server-272856876</nova:name>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:48:39</nova:creationTime>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:48:44 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:48:44 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:owner>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:user uuid="05e265c175d7422384c48db8e4d2fb3f">tempest-TaggedBootDevicesTest-311311515-project-member</nova:user>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:project uuid="9d482f428b6d49e0b2af74845e86d783">tempest-TaggedBootDevicesTest-311311515</nova:project>
Oct 25 22:48:44 user nova-compute[74507]:       </nova:owner>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:48:44 user nova-compute[74507]:       <nova:ports>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="782dad1b-229f-4bd4-9a28-fb348bfc801a">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="fec4791d-ab24-4c6f-a396-d18f8197bc9e">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="ff0dfd8b-a746-44a4-9eea-df1f71183130">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="b02f9395-653f-453f-ba8a-e4e184646b1e">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:         <nova:port uuid="97569942-737f-4bcf-88e4-d2078ec77c34">
Oct 25 22:48:44 user nova-compute[74507]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 22:48:44 user nova-compute[74507]:         </nova:port>
Oct 25 22:48:44 user nova-compute[74507]:       </nova:ports>
Oct 25 22:48:44 user nova-compute[74507]:     </nova:instance>
Oct 25 22:48:44 user nova-compute[74507]:   </metadata>
Oct 25 22:48:44 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:48:44 user nova-compute[74507]:     <system>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="serial">12340c14-7420-436a-957e-a7570a6ffadc</entry>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="uuid">12340c14-7420-436a-957e-a7570a6ffadc</entry>
Oct 25 22:48:44 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:48:44 user nova-compute[74507]:     </system>
Oct 25 22:48:44 user nova-compute[74507]:   </sysinfo>
Oct 25 22:48:44 user nova-compute[74507]:   <os>
Oct 25 22:48:44 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:48:44 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:48:44 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:48:44 user nova-compute[74507]:   </os>
Oct 25 22:48:44 user nova-compute[74507]:   <features>
Oct 25 22:48:44 user nova-compute[74507]:     <acpi/>
Oct 25 22:48:44 user nova-compute[74507]:     <apic/>
Oct 25 22:48:44 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:48:44 user nova-compute[74507]:   </features>
Oct 25 22:48:44 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:48:44 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:48:44 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:48:44 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:48:44 user nova-compute[74507]:   </clock>
Oct 25 22:48:44 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:48:44 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:48:44 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:48:44 user nova-compute[74507]:   </cpu>
Oct 25 22:48:44 user nova-compute[74507]:   <devices>
Oct 25 22:48:44 user nova-compute[74507]:     <disk type="file" device="cdrom">
Oct 25 22:48:44 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 22:48:44 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/disk.config"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="hda" bus="ide"/>
Oct 25 22:48:44 user nova-compute[74507]:     </disk>
Oct 25 22:48:44 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:48:44 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:44 user nova-compute[74507]:       <source dev="/dev/sdg"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <serial>05ec9b82-174a-427b-8fd5-d547c48a7361</serial>
Oct 25 22:48:44 user nova-compute[74507]:     </disk>
Oct 25 22:48:44 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:48:44 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:44 user nova-compute[74507]:       <source dev="/dev/sdh"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <serial>22fd7c60-6039-4867-8c93-12c01a712b9c</serial>
Oct 25 22:48:44 user nova-compute[74507]:     </disk>
Oct 25 22:48:44 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:48:44 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:48:44 user nova-compute[74507]:       <source dev="/dev/sdi"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="vdc" bus="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <serial>9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef</serial>
Oct 25 22:48:44 user nova-compute[74507]:     </disk>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:6b:36:c2"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tap6970bdb7-84"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:60:3f:68"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tap782dad1b-22"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:76:70:b7"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tapfec4791d-ab"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:19:75:d8"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tapff0dfd8b-a7"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:df:a2:30"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tap7cca5ad3-f7"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:fd:91:9b"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tapb02f9395-65"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:48:44 user nova-compute[74507]:       <mac address="fa:16:3e:07:6c:f6"/>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:48:44 user nova-compute[74507]:       <target dev="tap97569942-73"/>
Oct 25 22:48:44 user nova-compute[74507]:     </interface>
Oct 25 22:48:44 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:48:44 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/console.log" append="off"/>
Oct 25 22:48:44 user nova-compute[74507]:     </serial>
Oct 25 22:48:44 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:48:44 user nova-compute[74507]:     <video>
Oct 25 22:48:44 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:48:44 user nova-compute[74507]:     </video>
Oct 25 22:48:44 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:48:44 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:48:44 user nova-compute[74507]:     </rng>
Oct 25 22:48:44 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:48:44 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:48:44 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:48:44 user nova-compute[74507]:     </memballoon>
Oct 25 22:48:44 user nova-compute[74507]:   </devices>
Oct 25 22:48:44 user nova-compute[74507]: </domain>
Oct 25 22:48:44 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc9bfdc8-c4c9-5aea-bc51-20cd2e9fff1f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6970bdb7-84, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6970bdb7-84, col_values=(('qos', UUID('88a2289b-8ffe-457a-ad74-1595c2c0dc77')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6970bdb7-84, col_values=(('external_ids', {'iface-id': '6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:36:c2', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84')
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7119fce8-10fb-5201-a913-2e7086227428', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap782dad1b-22, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap782dad1b-22, col_values=(('qos', UUID('9d2d52c0-8079-4bbc-9be4-0bcbf4be71e6')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap782dad1b-22, col_values=(('external_ids', {'iface-id': '782dad1b-229f-4bd4-9a28-fb348bfc801a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:3f:68', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22')
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac03a111-5bf1-584d-b3b8-aa59f34b7d0f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfec4791d-ab, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfec4791d-ab, col_values=(('qos', UUID('ff131b01-7d1d-431c-b9db-27aee15f9f87')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfec4791d-ab, col_values=(('external_ids', {'iface-id': 'fec4791d-ab24-4c6f-a396-d18f8197bc9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:70:b7', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab')
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5ff141e-324f-5513-93e7-9d1317bd8bd3', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff0dfd8b-a7, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff0dfd8b-a7, col_values=(('qos', UUID('1dcee5e0-6f4f-4aa5-86bf-093486ba01c8')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff0dfd8b-a7, col_values=(('external_ids', {'iface-id': 'ff0dfd8b-a746-44a4-9eea-df1f71183130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:75:d8', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7')
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b05cf5b-2598-55e1-a170-0e308cfd0c44', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cca5ad3-f7, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cca5ad3-f7, col_values=(('qos', UUID('bb2963fe-55bb-463c-845e-b94125934b46')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cca5ad3-f7, col_values=(('external_ids', {'iface-id': '7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:a2:30', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7')
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b185fdb-ec30-5e6a-9341-93e03d62ab76', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb02f9395-65, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb02f9395-65, col_values=(('qos', UUID('64fca8f7-ace4-4c78-a9ac-ceabf39e4ccf')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb02f9395-65, col_values=(('external_ids', {'iface-id': 'b02f9395-653f-453f-ba8a-e4e184646b1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:91:9b', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65')
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '710c131a-89c3-54c2-9c75-72ba153f2bbc', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97569942-73, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97569942-73, col_values=(('qos', UUID('75f7c872-0407-428f-a1d9-d094e7fac72a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97569942-73, col_values=(('external_ids', {'iface-id': '97569942-737f-4bcf-88e4-d2078ec77c34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:6c:f6', 'vm-uuid': '12340c14-7420-436a-957e-a7570a6ffadc'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:45 user nova-compute[74507]: INFO os_vif [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73')
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] No BDM found with device name hda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] No VIF found with MAC fa:16:3e:6b:36:c2, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] No VIF found with MAC fa:16:3e:df:a2:30, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:48:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Using config drive
Oct 25 22:48:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Creating config drive at /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/disk.config
Oct 25 22:48:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl0algh4g {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:48:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl0algh4g" returned: 0 in 0.063s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:47 user nova-compute[74507]: WARNING nova.compute.manager [req-d1f050b5-feeb-4eb6-ad5a-1f4f5ef03f2b req-b1e21f5b-83fa-4f7d-9a16-c3656c725ab0 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa for instance with vm_state building and task_state spawning.
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:48 user nova-compute[74507]: WARNING nova.compute.manager [req-30519d42-bb45-4bf1-aa3d-ee4b9fc2081b req-f6382337-bd0c-4038-975b-6102427c5cb1 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e for instance with vm_state building and task_state spawning.
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:49 user nova-compute[74507]: WARNING nova.compute.manager [req-085feb03-f8c9-4304-b744-e6dd3c21a2b5 req-9bf269fe-07fa-45c8-96f1-97662a9dda34 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae for instance with vm_state building and task_state spawning.
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:49 user nova-compute[74507]: WARNING nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa for instance with vm_state building and task_state spawning.
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:49 user nova-compute[74507]: WARNING nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a for instance with vm_state building and task_state spawning.
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:49 user nova-compute[74507]: WARNING nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a for instance with vm_state building and task_state spawning.
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:49 user nova-compute[74507]: WARNING nova.compute.manager [req-5c1afcbe-cc74-4be8-9494-2fd8582e1d87 req-98196b56-b162-452c-ac4e-468aa56fa8ce service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e for instance with vm_state building and task_state spawning.
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:50 user nova-compute[74507]: WARNING nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e for instance with vm_state building and task_state spawning.
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:50 user nova-compute[74507]: WARNING nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 for instance with vm_state building and task_state spawning.
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:50 user nova-compute[74507]: WARNING nova.compute.manager [req-b9a67ce8-d3ac-4010-9470-d7d0b855e032 req-42837d56-981f-492b-8389-e551dc981367 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 for instance with vm_state building and task_state spawning.
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:51 user nova-compute[74507]: WARNING nova.compute.manager [req-ff21277e-9aff-4427-b31c-55e941a21c66 req-4acc3b95-9598-41cc-81f7-81f6f2f4f452 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae for instance with vm_state building and task_state spawning.
Oct 25 22:48:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:51 user nova-compute[74507]: WARNING nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e for instance with vm_state building and task_state spawning.
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:51 user nova-compute[74507]: WARNING nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 for instance with vm_state building and task_state spawning.
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:48:51 user nova-compute[74507]: WARNING nova.compute.manager [req-78c31779-c0f7-4060-8311-d31601ec3473 req-34df79ed-51fb-42d8-bb9c-ca907e9998f3 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 for instance with vm_state building and task_state spawning.
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:48:52 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance spawned successfully.
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:48:52 user nova-compute[74507]: INFO nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Took 13.17 seconds to spawn the instance on the hypervisor.
Oct 25 22:48:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:48:52 user nova-compute[74507]: INFO nova.compute.manager [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Took 89.09 seconds to build instance.
Oct 25 22:48:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fc6f4fb1-4706-4628-b769-e3796358b642 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 89.223s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:48:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:48:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:49:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:01 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a24bc0e5-a941-49ce-b5f4-36308b71620c is timed out.
Oct 25 22:49:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully detached device vdb from instance a24bc0e5-a941-49ce-b5f4-36308b71620c from the live domain config.
Oct 25 22:49:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VDWGRkZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:01 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95147e9-c376-477a-bad3-7b80b77a41b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:49:01 user nova-compute[74507]: No targets found.
Oct 25 22:49:01 user nova-compute[74507]: iSNS:
Oct 25 22:49:01 user nova-compute[74507]: No targets found.
Oct 25 22:49:01 user nova-compute[74507]: STATIC:
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95
Oct 25 22:49:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:01 user nova-compute[74507]: FIRMWARE:
Oct 25 22:49:01 user nova-compute[74507]: No targets found.
Oct 25 22:49:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:49:01 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:49:01 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4aa838-89c0-4cd0-ad74-c8d509e8d0b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8c553-5f58-4ae6-81b7-df9183418b29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:01 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac7564-78ec-4826-a938-289a4208ee9f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9005d3cf-6f7a-40eb-b9ef-b4832e4d677f]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba3fe2-3767-4943-8390-0fdd013ac1d9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71389e69-a72d-45b8-b7e1-fd1a3054d84e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c867c7-1995-47fb-8317-10dc8e0b86b1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee6d122-206f-444c-88b3-0cfa3275fcbe]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260]
Oct 25 22:49:01 user nova-compute[74507]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c07b781-a189-4d80-b381-82fcc53094a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f799df-b387-449b-ab68-c2555fd6a78f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] <== disconnect_volume: return (357ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:49:02 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 is timed out.
Oct 25 22:49:02 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully detached device vdb from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the live domain config.
Oct 25 22:49:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrpPDfVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:02 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1b1a73-6ab9-462e-a3a3-44f9648143f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:49:02 user nova-compute[74507]: No targets found.
Oct 25 22:49:02 user nova-compute[74507]: iSNS:
Oct 25 22:49:02 user nova-compute[74507]: No targets found.
Oct 25 22:49:02 user nova-compute[74507]: STATIC:
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95
Oct 25 22:49:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:02 user nova-compute[74507]: FIRMWARE:
Oct 25 22:49:02 user nova-compute[74507]: No targets found.
Oct 25 22:49:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:49:02 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:49:02 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a031b458-5d2e-4e3e-af1e-1dd08882a251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[584edc1f-b82e-45d6-abce-7749ff4badd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:02 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64353f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e91bc62-0b3e-46dc-ab01-c376999ab0f8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df6f282-d441-4ad1-be9c-f0bde29bebf5]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b4073-e9dc-427a-ad81-a77b17903d0e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a245874b-8c60-4921-aefe-3703c048544f]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'flavor' on Instance uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d81608-2bbb-411f-9000-27d242e6158d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9f015821-d0ee-44ee-a81c-b8e7d80cfa3e tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.184s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2207c14c-eaaf-46ec-862d-44653da0ad2e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260]
Oct 25 22:49:02 user nova-compute[74507]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16dc717-9afa-4f80-854c-92eab7ee09e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b208d4-d431-45c8-b1f8-a9abb999e4f4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] <== disconnect_volume: return (448ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:49:03 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ee2afc8-b278-4b64-ad08-213cc752a982 is timed out.
Oct 25 22:49:03 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Successfully detached device vdb from instance 9ee2afc8-b278-4b64-ad08-213cc752a982 from the live domain config.
Oct 25 22:49:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIyULpVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:03 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34388f9b-3f35-4742-99f1-0210c16256c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:49:03 user nova-compute[74507]: No targets found.
Oct 25 22:49:03 user nova-compute[74507]: iSNS:
Oct 25 22:49:03 user nova-compute[74507]: No targets found.
Oct 25 22:49:03 user nova-compute[74507]: STATIC:
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95
Oct 25 22:49:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:03 user nova-compute[74507]: FIRMWARE:
Oct 25 22:49:03 user nova-compute[74507]: No targets found.
Oct 25 22:49:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:49:03 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:49:03 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3eb008-3b63-4344-b168-5fbd3be88349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf4471-6f5e-4db5-98cb-7c690d9c93e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:03 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95'): ({'sdf'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Removing single pathed devices sdf {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad6b11d-a556-4e04-9cfc-5b184b63d704]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced02daf-8b88-4728-a638-40c781690ca5]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Flushing IO for device /dev/sdf {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[414cf0eb-c83a-4ad1-a167-e0847199901d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b7e27f-34da-4f3a-9812-caa31d36f5f7]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d16c5b9-191e-4d40-9bd7-b02c0a5c436c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfce74a-0b86-4461-abc0-41b9f4403752]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260]
Oct 25 22:49:03 user nova-compute[74507]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0860d512-8b03-4b9f-b4eb-41299e835f95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7545593d-3f36-4a20-b8ae-b01b3d9f2b09]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] <== disconnect_volume: return (365ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG nova.objects.instance [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-704ff853-3251-4e10-b9c8-5a78c8e2a2b0 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.190s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:04 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lazy-loading 'flavor' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fbf02ee4-9c09-46c7-84f2-c2facdc0fbbe tempest-VolumesAssistedSnapshotsTest-1645249968 tempest-VolumesAssistedSnapshotsTest-1645249968-project-admin] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.224s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-50722c3b-5921-4cb9-ad90-e07a8d534500" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-50722c3b-5921-4cb9-ad90-e07a8d534500" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Attempting to detach device tap50722c3b-59 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] detach device xml: <interface type="ethernet">
Oct 25 22:49:05 user nova-compute[74507]:   <mac address="fa:16:3e:fc:94:e2"/>
Oct 25 22:49:05 user nova-compute[74507]:   <model type="virtio"/>
Oct 25 22:49:05 user nova-compute[74507]:   <mtu size="1442"/>
Oct 25 22:49:05 user nova-compute[74507]:   <target dev="tap50722c3b-59"/>
Oct 25 22:49:05 user nova-compute[74507]: </interface>
Oct 25 22:49:05 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 25 22:49:05 user nova-compute[74507]:   <name>instance-00000009</name>
Oct 25 22:49:05 user nova-compute[74507]:   <uuid>05535d1f-7a9b-46e6-ba67-4709507a3ee4</uuid>
Oct 25 22:49:05 user nova-compute[74507]:   <metadata>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:05 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:48:02</nova:creationTime>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:05 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:05 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:05 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:05 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:05 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:05 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:05 user nova-compute[74507]:     <nova:port uuid="50722c3b-5921-4cb9-ad90-e07a8d534500">
Oct 25 22:49:05 user nova-compute[74507]:       <nova:ip type="fixed" address="10.10.10.108" ipVersion="4"/>
Oct 25 22:49:05 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:05 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:05 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:05 user nova-compute[74507]:   </metadata>
Oct 25 22:49:05 user nova-compute[74507]:   <memory unit='KiB'>524288</memory>
Oct 25 22:49:05 user nova-compute[74507]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 22:49:05 user nova-compute[74507]:   <vcpu placement='static'>1</vcpu>
Oct 25 22:49:05 user nova-compute[74507]:   <resource>
Oct 25 22:49:05 user nova-compute[74507]:     <partition>/machine</partition>
Oct 25 22:49:05 user nova-compute[74507]:   </resource>
Oct 25 22:49:05 user nova-compute[74507]:   <sysinfo type='smbios'>
Oct 25 22:49:05 user nova-compute[74507]:     <system>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='version'>0.0.0</entry>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='serial'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='uuid'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:05 user nova-compute[74507]:       <entry name='family'>Virtual Machine</entry>
Oct 25 22:49:05 user nova-compute[74507]:     </system>
Oct 25 22:49:05 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:05 user nova-compute[74507]:   <os>
Oct 25 22:49:05 user nova-compute[74507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 22:49:05 user nova-compute[74507]:     <boot dev='hd'/>
Oct 25 22:49:05 user nova-compute[74507]:     <smbios mode='sysinfo'/>
Oct 25 22:49:05 user nova-compute[74507]:   </os>
Oct 25 22:49:05 user nova-compute[74507]:   <features>
Oct 25 22:49:05 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:05 user nova-compute[74507]:     <apic/>
Oct 25 22:49:05 user nova-compute[74507]:     <vmcoreinfo state='on'/>
Oct 25 22:49:05 user nova-compute[74507]:   </features>
Oct 25 22:49:05 user nova-compute[74507]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 22:49:05 user nova-compute[74507]:     <model fallback='forbid'>Nehalem</model>
Oct 25 22:49:05 user nova-compute[74507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 22:49:05 user nova-compute[74507]:     <feature policy='require' name='vme'/>
Oct 25 22:49:05 user nova-compute[74507]:     <feature policy='require' name='x2apic'/>
Oct 25 22:49:05 user nova-compute[74507]:     <feature policy='require' name='hypervisor'/>
Oct 25 22:49:05 user nova-compute[74507]:   </cpu>
Oct 25 22:49:05 user nova-compute[74507]:   <clock offset='utc'>
Oct 25 22:49:05 user nova-compute[74507]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 22:49:05 user nova-compute[74507]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 22:49:05 user nova-compute[74507]:     <timer name='hpet' present='no'/>
Oct 25 22:49:05 user nova-compute[74507]:   </clock>
Oct 25 22:49:05 user nova-compute[74507]:   <on_poweroff>destroy</on_poweroff>
Oct 25 22:49:05 user nova-compute[74507]:   <on_reboot>restart</on_reboot>
Oct 25 22:49:05 user nova-compute[74507]:   <on_crash>destroy</on_crash>
Oct 25 22:49:05 user nova-compute[74507]:   <devices>
Oct 25 22:49:05 user nova-compute[74507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 22:49:05 user nova-compute[74507]:     <disk type='file' device='disk'>
Oct 25 22:49:05 user nova-compute[74507]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 22:49:05 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk' index='2'/>
Oct 25 22:49:05 user nova-compute[74507]:       <backingStore type='file' index='3'>
Oct 25 22:49:05 user nova-compute[74507]:         <format type='raw'/>
Oct 25 22:49:05 user nova-compute[74507]:         <source file='/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab'/>
Oct 25 22:49:05 user nova-compute[74507]:         <backingStore/>
Oct 25 22:49:05 user nova-compute[74507]:       </backingStore>
Oct 25 22:49:05 user nova-compute[74507]:       <target dev='vda' bus='virtio'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='virtio-disk0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </disk>
Oct 25 22:49:05 user nova-compute[74507]:     <disk type='file' device='cdrom'>
Oct 25 22:49:05 user nova-compute[74507]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 22:49:05 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config' index='1'/>
Oct 25 22:49:05 user nova-compute[74507]:       <backingStore/>
Oct 25 22:49:05 user nova-compute[74507]:       <target dev='hda' bus='ide'/>
Oct 25 22:49:05 user nova-compute[74507]:       <readonly/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='ide0-0-0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </disk>
Oct 25 22:49:05 user nova-compute[74507]:     <controller type='usb' index='0' model='none'>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='usb'/>
Oct 25 22:49:05 user nova-compute[74507]:     </controller>
Oct 25 22:49:05 user nova-compute[74507]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='pci.0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </controller>
Oct 25 22:49:05 user nova-compute[74507]:     <controller type='ide' index='0'>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='ide'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 22:49:05 user nova-compute[74507]:     </controller>
Oct 25 22:49:05 user nova-compute[74507]:     <interface type='ethernet'>
Oct 25 22:49:05 user nova-compute[74507]:       <mac address='fa:16:3e:c9:0d:47'/>
Oct 25 22:49:05 user nova-compute[74507]:       <target dev='tap5c7f140a-fa'/>
Oct 25 22:49:05 user nova-compute[74507]:       <model type='virtio'/>
Oct 25 22:49:05 user nova-compute[74507]:       <mtu size='1442'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='net0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </interface>
Oct 25 22:49:05 user nova-compute[74507]:     <interface type='ethernet'>
Oct 25 22:49:05 user nova-compute[74507]:       <mac address='fa:16:3e:fc:94:e2'/>
Oct 25 22:49:05 user nova-compute[74507]:       <target dev='tap50722c3b-59'/>
Oct 25 22:49:05 user nova-compute[74507]:       <model type='virtio'/>
Oct 25 22:49:05 user nova-compute[74507]:       <mtu size='1442'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='net1'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </interface>
Oct 25 22:49:05 user nova-compute[74507]:     <serial type='pty'>
Oct 25 22:49:05 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:05 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:05 user nova-compute[74507]:       <target type='isa-serial' port='0'>
Oct 25 22:49:05 user nova-compute[74507]:         <model name='isa-serial'/>
Oct 25 22:49:05 user nova-compute[74507]:       </target>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </serial>
Oct 25 22:49:05 user nova-compute[74507]:     <console type='pty' tty='/dev/pts/8'>
Oct 25 22:49:05 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:05 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:05 user nova-compute[74507]:       <target type='serial' port='0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </console>
Oct 25 22:49:05 user nova-compute[74507]:     <input type='mouse' bus='ps2'>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='input0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </input>
Oct 25 22:49:05 user nova-compute[74507]:     <input type='keyboard' bus='ps2'>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='input1'/>
Oct 25 22:49:05 user nova-compute[74507]:     </input>
Oct 25 22:49:05 user nova-compute[74507]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 25 22:49:05 user nova-compute[74507]:       <listen type='address' address='0.0.0.0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </graphics>
Oct 25 22:49:05 user nova-compute[74507]:     <audio id='1' type='none'/>
Oct 25 22:49:05 user nova-compute[74507]:     <video>
Oct 25 22:49:05 user nova-compute[74507]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='video0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </video>
Oct 25 22:49:05 user nova-compute[74507]:     <memballoon model='virtio'>
Oct 25 22:49:05 user nova-compute[74507]:       <stats period='10'/>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='balloon0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:05 user nova-compute[74507]:     <rng model='virtio'>
Oct 25 22:49:05 user nova-compute[74507]:       <backend model='random'>/dev/urandom</backend>
Oct 25 22:49:05 user nova-compute[74507]:       <alias name='rng0'/>
Oct 25 22:49:05 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 22:49:05 user nova-compute[74507]:     </rng>
Oct 25 22:49:05 user nova-compute[74507]:   </devices>
Oct 25 22:49:05 user nova-compute[74507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 22:49:05 user nova-compute[74507]:     <label>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</label>
Oct 25 22:49:05 user nova-compute[74507]:     <imagelabel>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</imagelabel>
Oct 25 22:49:05 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:05 user nova-compute[74507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 22:49:05 user nova-compute[74507]:     <label>+64055:+108</label>
Oct 25 22:49:05 user nova-compute[74507]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 22:49:05 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:05 user nova-compute[74507]: </domain>
Oct 25 22:49:05 user nova-compute[74507]:  {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 22:49:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully detached device tap50722c3b-59 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the persistent domain config.
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] (1/8): Attempting to detach device tap50722c3b-59 with device alias net1 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] detach device xml: <interface type="ethernet">
Oct 25 22:49:05 user nova-compute[74507]:   <mac address="fa:16:3e:fc:94:e2"/>
Oct 25 22:49:05 user nova-compute[74507]:   <model type="virtio"/>
Oct 25 22:49:05 user nova-compute[74507]:   <mtu size="1442"/>
Oct 25 22:49:05 user nova-compute[74507]:   <target dev="tap50722c3b-59"/>
Oct 25 22:49:05 user nova-compute[74507]: </interface>
Oct 25 22:49:05 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Start waiting for the detach event from libvirt for device tap50722c3b-59 with device alias net1 for instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-unplugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-unplugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:05 user nova-compute[74507]: WARNING nova.compute.manager [req-ffd9e6ba-af8d-40ad-b3b1-91f9d8e71be9 req-00df99f2-4e5d-4b52-9bfd-dd1821584d06 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-unplugged-50722c3b-5921-4cb9-ad90-e07a8d534500 for instance with vm_state active and task_state None.
Oct 25 22:49:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:07 user nova-compute[74507]: WARNING nova.compute.manager [req-dc85777a-41b5-4f68-a8ad-ddc09705b359 req-ea431fe0-eb31-40f4-8bcd-bb3b2072f020 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-50722c3b-5921-4cb9-ad90-e07a8d534500 for instance with vm_state active and task_state None.
Oct 25 22:49:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhZzLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:13 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f6414-1df4-47c6-9521-66d7fe466a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:49:13 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d845901-44e7-45c5-beab-703dc9558a13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f] added
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b', 'serial': '47091bba-a724-4790-af09-7c8e8211cf8b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'serial'} {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8094ae60-7367-4f51-b3dd-8e0dc4331c6d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e01ff0-e3b4-41ed-929e-03f83d68882c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jhZzLAKy {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jhZzLAKy" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1e31e-7008-41e2-97d3-047ff73bb91f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jhZzLAKy'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[118edff4-468c-4f83-96d2-dba9d98ef028]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17daad7e-54ef-41d7-a790-28234164941a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388ef0d-6493-41b9-aa75-94031479e481]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260]
Oct 25 22:49:13 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09573e0a-5a8e-42bf-8940-95881f2d8f12]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd64c98-cfae-4541-8d69-83fd097bdca5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd6fa11-4188-4495-a3ea-28e7bfa7024a]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhZzLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26161346263333134', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161346263333134', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.313s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:14 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lazy-loading 'flavor' on Instance uuid c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790c3a5-f433-4f6c-91e0-e4714230d793]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:49:14 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:49:14 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:49:14 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:49:14 user nova-compute[74507]:   <target dev="sdc" bus="scsi"/>
Oct 25 22:49:14 user nova-compute[74507]:   <serial>020146d1-0dbe-4475-a4f8-d442867c072f</serial>
Oct 25 22:49:14 user nova-compute[74507]:   <address type="drive" controller="0" unit="2"/>
Oct 25 22:49:14 user nova-compute[74507]: </disk>
Oct 25 22:49:14 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e20780-8076-4579-b356-b01eb59f981b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b] added
Oct 25 22:49:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6332d0-38d4-435f-9980-b5ca0cc7dc48]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43558b7e-3745-4383-9fb7-fe3170ec49b3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHpWftwo {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHpWftwo" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd721a32-9ad5-431b-8d2d-37f88a3638b9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHpWftwo'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6dab9-b040-445b-9d81-7f6179b77d0e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc73c15-9743-43cf-afcd-9174757efcae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:14 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f98af-9494-43e9-9829-4e2724ec5dfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260]
Oct 25 22:49:14 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1436f52-cb6e-4369-8fb7-462e4a8c30e7]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb4f2c5-df6b-4b0d-a4c0-643e8d489bd1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:15 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4dfbe5-1074-4712-a8f1-cc30911df47b]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No BDM found with device name sda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] No VIF found with MAC fa:16:3e:d4:01:bf, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bda6e5de-30d7-45f0-8903-094b8c24d94d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.194s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== connect_volume: return (2724ms) {'type': 'block', 'scsi_wwn': '23535396561346633', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535396561346633', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lazy-loading 'flavor' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=74507) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 25 22:49:16 user nova-compute[74507]: INFO nova.virt.libvirt.host [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] UEFI support detected
Oct 25 22:49:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:16 user nova-compute[74507]: INFO nova.compute.manager [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Detaching volume 020146d1-0dbe-4475-a4f8-d442867c072f
Oct 25 22:49:16 user nova-compute[74507]: INFO nova.virt.block_device [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Attempting to driver detach volume 020146d1-0dbe-4475-a4f8-d442867c072f from mountpoint /dev/sdc
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Attempting to detach device sdc from instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:49:16 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:49:16 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:49:16 user nova-compute[74507]:   <target dev="sdc" bus="scsi"/>
Oct 25 22:49:16 user nova-compute[74507]:   <serial>020146d1-0dbe-4475-a4f8-d442867c072f</serial>
Oct 25 22:49:16 user nova-compute[74507]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 22:49:16 user nova-compute[74507]: </disk>
Oct 25 22:49:16 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:49:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Successfully detached device sdc from instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 from the persistent domain config.
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:49:16 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:49:16 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:49:16 user nova-compute[74507]:   <target dev="sdc" bus="scsi"/>
Oct 25 22:49:16 user nova-compute[74507]:   <serial>020146d1-0dbe-4475-a4f8-d442867c072f</serial>
Oct 25 22:49:16 user nova-compute[74507]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 22:49:16 user nova-compute[74507]: </disk>
Oct 25 22:49:16 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:49:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 147849216 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 593494016 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 734003200 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 895483904 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 1041235968 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:49:20 user nova-compute[74507]: INFO nova.compute.claims [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Claim successful on node user
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:20 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0033d-16be-422e-990e-2777053076f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:49:20 user nova-compute[74507]: No targets found.
Oct 25 22:49:20 user nova-compute[74507]: iSNS:
Oct 25 22:49:20 user nova-compute[74507]: No targets found.
Oct 25 22:49:20 user nova-compute[74507]: STATIC:
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f
Oct 25 22:49:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:20 user nova-compute[74507]: FIRMWARE:
Oct 25 22:49:20 user nova-compute[74507]: No targets found.
Oct 25 22:49:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:49:20 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:49:20 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c8d09-d934-4180-b47c-985dafa83b92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866c563-7fb6-4a8c-a953-9fd018542886]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:20 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6f7d2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[720206f0-b3c0-4f1a-a03d-f901b3db02db]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687de9c-384e-4c93-8ff3-ec406fc9acff]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f293511-e80e-4115-a399-dcb8bf272016]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6c50f-c239-4d1b-b095-af8c28e2a7a5]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93ce1b7-3209-407c-9a65-5b8c84e4c261]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:20 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dee63e4-79ea-4f62-bc9b-4a5edada1f49]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]
Oct 25 22:49:21 user nova-compute[74507]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[21933d49-b765-4ebb-8202-0c09440571dd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== disconnect_volume: return (353ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:49:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b', 'serial'} {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: removing Cinder connection for volume ee9806f9-4d2c-4681-9b2a-a07945b0e837 {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.policy [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1673b4507d547f0b1286d8f0a56f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fbc92865504ccf9f8f83c3b530227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:49:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Creating image(s)
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "/opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "/opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "/opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk 1073741824" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Successfully created port: e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.229s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:49:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Cannot resize image /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Ensure instance console log exists: /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: Updating volume ee9806f9-4d2c-4681-9b2a-a07945b0e837 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zHpWftwo", "auth_password": "yNLT4gXAv9IzaG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "47091bba-a724-4790-af09-7c8e8211cf8b"}, "status": "reserved", "instance": "2db7899e-3a31-4fd6-aece-6cf9b669c96b", "attached_at": "", "detached_at": "", "volume_id": "47091bba-a724-4790-af09-7c8e8211cf8b", "serial": "47091bba-a724-4790-af09-7c8e8211cf8b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b', 'no_device': None, 'attachment_id': '4334ce1f-0982-4ae0-a85c-34e089953875'} {{(pid=74507) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-299c8e54-570b-4c4e-9604-5feb9ac27234 tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 41.833s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Successfully updated port: e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquired lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing instance network info cache due to event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] Acquiring lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Releasing lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Instance network_info: |[{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] Acquired lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Start _get_guest_xml network_info=[{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG os_brick.utils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe022e75-fa00-4eb0-8d28-b28f63e06796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-395427938',display_name='tempest-TestStampPattern-server-395427938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-395427938',id=12,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-1qz0u95s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:21Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=734cab0d-b6c6-4a43-95fa-cdd885639464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'pci_devices' on Instance uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d385a-a3b0-4a5a-9a51-b8ec8ab84926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:49:22 user nova-compute[74507]:   <uuid>734cab0d-b6c6-4a43-95fa-cdd885639464</uuid>
Oct 25 22:49:22 user nova-compute[74507]:   <name>instance-0000000c</name>
Oct 25 22:49:22 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:49:22 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:49:22 user nova-compute[74507]:   <metadata>
Oct 25 22:49:22 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:22 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:name>tempest-TestStampPattern-server-395427938</nova:name>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:49:22</nova:creationTime>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:49:22 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:22 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:owner>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:user uuid="a1673b4507d547f0b1286d8f0a56f3b3">tempest-TestStampPattern-899029107-project-member</nova:user>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:project uuid="d8fbc92865504ccf9f8f83c3b530227d">tempest-TestStampPattern-899029107</nova:project>
Oct 25 22:49:22 user nova-compute[74507]:       </nova:owner>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:22 user nova-compute[74507]:       <nova:ports>
Oct 25 22:49:22 user nova-compute[74507]:         <nova:port uuid="e33e95f6-07ba-4d59-acc3-c542e36653fa">
Oct 25 22:49:22 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 22:49:22 user nova-compute[74507]:         </nova:port>
Oct 25 22:49:22 user nova-compute[74507]:       </nova:ports>
Oct 25 22:49:22 user nova-compute[74507]:     </nova:instance>
Oct 25 22:49:22 user nova-compute[74507]:   </metadata>
Oct 25 22:49:22 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:49:22 user nova-compute[74507]:     <system>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="serial">734cab0d-b6c6-4a43-95fa-cdd885639464</entry>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="uuid">734cab0d-b6c6-4a43-95fa-cdd885639464</entry>
Oct 25 22:49:22 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:49:22 user nova-compute[74507]:     </system>
Oct 25 22:49:22 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:22 user nova-compute[74507]:   <os>
Oct 25 22:49:22 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:49:22 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:49:22 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:49:22 user nova-compute[74507]:   </os>
Oct 25 22:49:22 user nova-compute[74507]:   <features>
Oct 25 22:49:22 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:22 user nova-compute[74507]:     <apic/>
Oct 25 22:49:22 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:49:22 user nova-compute[74507]:   </features>
Oct 25 22:49:22 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:49:22 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:49:22 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:49:22 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:49:22 user nova-compute[74507]:   </clock>
Oct 25 22:49:22 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:49:22 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:49:22 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:49:22 user nova-compute[74507]:   </cpu>
Oct 25 22:49:22 user nova-compute[74507]:   <devices>
Oct 25 22:49:22 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:49:22 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:49:22 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk"/>
Oct 25 22:49:22 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:49:22 user nova-compute[74507]:     </disk>
Oct 25 22:49:22 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:49:22 user nova-compute[74507]:       <mac address="fa:16:3e:76:95:b6"/>
Oct 25 22:49:22 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:22 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:49:22 user nova-compute[74507]:       <target dev="tape33e95f6-07"/>
Oct 25 22:49:22 user nova-compute[74507]:     </interface>
Oct 25 22:49:22 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:49:22 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/console.log" append="off"/>
Oct 25 22:49:22 user nova-compute[74507]:     </serial>
Oct 25 22:49:22 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:49:22 user nova-compute[74507]:     <video>
Oct 25 22:49:22 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:22 user nova-compute[74507]:     </video>
Oct 25 22:49:22 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:49:22 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:49:22 user nova-compute[74507]:     </rng>
Oct 25 22:49:22 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:49:22 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:49:22 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:49:22 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:22 user nova-compute[74507]:   </devices>
Oct 25 22:49:22 user nova-compute[74507]: </domain>
Oct 25 22:49:22 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-395427938',display_name='tempest-TestStampPattern-server-395427938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-395427938',id=12,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-1qz0u95s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:21Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=734cab0d-b6c6-4a43-95fa-cdd885639464,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG os_vif [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8fa0bd-32c0-45d2-bbd2-2384f277bae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '117a9c4b-54b4-5de9-8232-3db4a5a8af62', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ccddf4-cd82-4919-bfd2-fad60523a7c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape33e95f6-07, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape33e95f6-07, col_values=(('qos', UUID('4dfd4777-6355-4e86-b9ee-d0a59b6ecb47')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape33e95f6-07, col_values=(('external_ids', {'iface-id': 'e33e95f6-07ba-4d59-acc3-c542e36653fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:95:b6', 'vm-uuid': '734cab0d-b6c6-4a43-95fa-cdd885639464'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:49:23 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:49:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe668775-8db6-4ffa-bfe4-741e1b68d8f9]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG os_brick.utils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:23 user nova-compute[74507]: INFO os_vif [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07')
Oct 25 22:49:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No VIF found with MAC fa:16:3e:76:95:b6, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:49:23 user nova-compute[74507]: INFO nova.compute.manager [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Swapping volume 47091bba-a724-4790-af09-7c8e8211cf8b for ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:49:23 user nova-compute[74507]: DEBUG nova.network.neutron [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updated VIF entry in instance network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG nova.network.neutron [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-647ca42e-1b23-4e53-9530-e62f6bc4b9b7 req-d7eadc76-f163-4073-8c71-777bba58a7df service nova] Releasing lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] No waiting events found dispatching network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:24 user nova-compute[74507]: WARNING nova.compute.manager [req-2fb4d8e5-f3d2-4a20-bdb1-977ee8261838 req-6777df78-5cb0-4413-b3bd-92fef8d153af service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received unexpected event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa for instance with vm_state building and task_state spawning.
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:49:25 user nova-compute[74507]: INFO nova.compute.claims [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Claim successful on node user
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Waiting for libvirt event about the detach of device tap50722c3b-59 with device alias net1 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 is timed out.
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 25 22:49:25 user nova-compute[74507]:   <name>instance-00000009</name>
Oct 25 22:49:25 user nova-compute[74507]:   <uuid>05535d1f-7a9b-46e6-ba67-4709507a3ee4</uuid>
Oct 25 22:49:25 user nova-compute[74507]:   <metadata>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:25 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:48:02</nova:creationTime>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:25 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:25 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:25 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:port uuid="50722c3b-5921-4cb9-ad90-e07a8d534500">
Oct 25 22:49:25 user nova-compute[74507]:       <nova:ip type="fixed" address="10.10.10.108" ipVersion="4"/>
Oct 25 22:49:25 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:25 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:25 user nova-compute[74507]:   </metadata>
Oct 25 22:49:25 user nova-compute[74507]:   <memory unit='KiB'>524288</memory>
Oct 25 22:49:25 user nova-compute[74507]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 22:49:25 user nova-compute[74507]:   <vcpu placement='static'>1</vcpu>
Oct 25 22:49:25 user nova-compute[74507]:   <resource>
Oct 25 22:49:25 user nova-compute[74507]:     <partition>/machine</partition>
Oct 25 22:49:25 user nova-compute[74507]:   </resource>
Oct 25 22:49:25 user nova-compute[74507]:   <sysinfo type='smbios'>
Oct 25 22:49:25 user nova-compute[74507]:     <system>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='version'>0.0.0</entry>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='serial'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='uuid'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:25 user nova-compute[74507]:       <entry name='family'>Virtual Machine</entry>
Oct 25 22:49:25 user nova-compute[74507]:     </system>
Oct 25 22:49:25 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:25 user nova-compute[74507]:   <os>
Oct 25 22:49:25 user nova-compute[74507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 22:49:25 user nova-compute[74507]:     <boot dev='hd'/>
Oct 25 22:49:25 user nova-compute[74507]:     <smbios mode='sysinfo'/>
Oct 25 22:49:25 user nova-compute[74507]:   </os>
Oct 25 22:49:25 user nova-compute[74507]:   <features>
Oct 25 22:49:25 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:25 user nova-compute[74507]:     <apic/>
Oct 25 22:49:25 user nova-compute[74507]:     <vmcoreinfo state='on'/>
Oct 25 22:49:25 user nova-compute[74507]:   </features>
Oct 25 22:49:25 user nova-compute[74507]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 22:49:25 user nova-compute[74507]:     <model fallback='forbid'>Nehalem</model>
Oct 25 22:49:25 user nova-compute[74507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 22:49:25 user nova-compute[74507]:     <feature policy='require' name='vme'/>
Oct 25 22:49:25 user nova-compute[74507]:     <feature policy='require' name='x2apic'/>
Oct 25 22:49:25 user nova-compute[74507]:     <feature policy='require' name='hypervisor'/>
Oct 25 22:49:25 user nova-compute[74507]:   </cpu>
Oct 25 22:49:25 user nova-compute[74507]:   <clock offset='utc'>
Oct 25 22:49:25 user nova-compute[74507]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 22:49:25 user nova-compute[74507]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 22:49:25 user nova-compute[74507]:     <timer name='hpet' present='no'/>
Oct 25 22:49:25 user nova-compute[74507]:   </clock>
Oct 25 22:49:25 user nova-compute[74507]:   <on_poweroff>destroy</on_poweroff>
Oct 25 22:49:25 user nova-compute[74507]:   <on_reboot>restart</on_reboot>
Oct 25 22:49:25 user nova-compute[74507]:   <on_crash>destroy</on_crash>
Oct 25 22:49:25 user nova-compute[74507]:   <devices>
Oct 25 22:49:25 user nova-compute[74507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 22:49:25 user nova-compute[74507]:     <disk type='file' device='disk'>
Oct 25 22:49:25 user nova-compute[74507]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 22:49:25 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk' index='2'/>
Oct 25 22:49:25 user nova-compute[74507]:       <backingStore type='file' index='3'>
Oct 25 22:49:25 user nova-compute[74507]:         <format type='raw'/>
Oct 25 22:49:25 user nova-compute[74507]:         <source file='/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab'/>
Oct 25 22:49:25 user nova-compute[74507]:         <backingStore/>
Oct 25 22:49:25 user nova-compute[74507]:       </backingStore>
Oct 25 22:49:25 user nova-compute[74507]:       <target dev='vda' bus='virtio'/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='virtio-disk0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </disk>
Oct 25 22:49:25 user nova-compute[74507]:     <disk type='file' device='cdrom'>
Oct 25 22:49:25 user nova-compute[74507]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 22:49:25 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config' index='1'/>
Oct 25 22:49:25 user nova-compute[74507]:       <backingStore/>
Oct 25 22:49:25 user nova-compute[74507]:       <target dev='hda' bus='ide'/>
Oct 25 22:49:25 user nova-compute[74507]:       <readonly/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='ide0-0-0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </disk>
Oct 25 22:49:25 user nova-compute[74507]:     <controller type='usb' index='0' model='none'>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='usb'/>
Oct 25 22:49:25 user nova-compute[74507]:     </controller>
Oct 25 22:49:25 user nova-compute[74507]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='pci.0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </controller>
Oct 25 22:49:25 user nova-compute[74507]:     <controller type='ide' index='0'>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='ide'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 22:49:25 user nova-compute[74507]:     </controller>
Oct 25 22:49:25 user nova-compute[74507]:     <interface type='ethernet'>
Oct 25 22:49:25 user nova-compute[74507]:       <mac address='fa:16:3e:c9:0d:47'/>
Oct 25 22:49:25 user nova-compute[74507]:       <target dev='tap5c7f140a-fa'/>
Oct 25 22:49:25 user nova-compute[74507]:       <model type='virtio'/>
Oct 25 22:49:25 user nova-compute[74507]:       <mtu size='1442'/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='net0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </interface>
Oct 25 22:49:25 user nova-compute[74507]:     <serial type='pty'>
Oct 25 22:49:25 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:25 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:25 user nova-compute[74507]:       <target type='isa-serial' port='0'>
Oct 25 22:49:25 user nova-compute[74507]:         <model name='isa-serial'/>
Oct 25 22:49:25 user nova-compute[74507]:       </target>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </serial>
Oct 25 22:49:25 user nova-compute[74507]:     <console type='pty' tty='/dev/pts/8'>
Oct 25 22:49:25 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:25 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:25 user nova-compute[74507]:       <target type='serial' port='0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </console>
Oct 25 22:49:25 user nova-compute[74507]:     <input type='mouse' bus='ps2'>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='input0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </input>
Oct 25 22:49:25 user nova-compute[74507]:     <input type='keyboard' bus='ps2'>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='input1'/>
Oct 25 22:49:25 user nova-compute[74507]:     </input>
Oct 25 22:49:25 user nova-compute[74507]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 25 22:49:25 user nova-compute[74507]:       <listen type='address' address='0.0.0.0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </graphics>
Oct 25 22:49:25 user nova-compute[74507]:     <audio id='1' type='none'/>
Oct 25 22:49:25 user nova-compute[74507]:     <video>
Oct 25 22:49:25 user nova-compute[74507]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='video0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </video>
Oct 25 22:49:25 user nova-compute[74507]:     <memballoon model='virtio'>
Oct 25 22:49:25 user nova-compute[74507]:       <stats period='10'/>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='balloon0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:25 user nova-compute[74507]:     <rng model='virtio'>
Oct 25 22:49:25 user nova-compute[74507]:       <backend model='random'>/dev/urandom</backend>
Oct 25 22:49:25 user nova-compute[74507]:       <alias name='rng0'/>
Oct 25 22:49:25 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 22:49:25 user nova-compute[74507]:     </rng>
Oct 25 22:49:25 user nova-compute[74507]:   </devices>
Oct 25 22:49:25 user nova-compute[74507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 22:49:25 user nova-compute[74507]:     <label>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</label>
Oct 25 22:49:25 user nova-compute[74507]:     <imagelabel>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</imagelabel>
Oct 25 22:49:25 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:25 user nova-compute[74507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 22:49:25 user nova-compute[74507]:     <label>+64055:+108</label>
Oct 25 22:49:25 user nova-compute[74507]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 22:49:25 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:25 user nova-compute[74507]: </domain>
Oct 25 22:49:25 user nova-compute[74507]:  {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 22:49:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully detached device tap50722c3b-59 from instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 from the live domain config.
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG os_vif [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50722c3b-59, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a70a163-aece-496a-91fa-859b458bffda) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:25 user nova-compute[74507]: INFO os_vif [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59')
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:25 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:49:25</nova:creationTime>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:25 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:25 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:25 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:25 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:25 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:25 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:25 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:25 user nova-compute[74507]:  {{(pid=74507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:49:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.policy [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40a2834cde90449e8067ae627d799836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bae88be410b4835bd2e0470ed90a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:49:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Creating image(s)
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-deleted-50722c3b-5921-4cb9-ad90-e07a8d534500 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:26 user nova-compute[74507]: INFO nova.compute.manager [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Neutron deleted interface 50722c3b-5921-4cb9-ad90-e07a8d534500; detaching it from the instance and deleting it from the info cache
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.neutron [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquired lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.objects.instance [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Lazy-loading 'system_metadata' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.objects.instance [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Lazy-loading 'flavor' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.objects.base [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Object Instance<05535d1f-7a9b-46e6-ba67-4709507a3ee4> lazy-loaded attributes: system_metadata,flavor {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 25 22:49:26 user nova-compute[74507]:   <name>instance-00000009</name>
Oct 25 22:49:26 user nova-compute[74507]:   <uuid>05535d1f-7a9b-46e6-ba67-4709507a3ee4</uuid>
Oct 25 22:49:26 user nova-compute[74507]:   <metadata>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:26 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:49:25</nova:creationTime>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:26 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:26 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:26 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:26 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:26 user nova-compute[74507]:   </metadata>
Oct 25 22:49:26 user nova-compute[74507]:   <memory unit='KiB'>524288</memory>
Oct 25 22:49:26 user nova-compute[74507]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 22:49:26 user nova-compute[74507]:   <vcpu placement='static'>1</vcpu>
Oct 25 22:49:26 user nova-compute[74507]:   <resource>
Oct 25 22:49:26 user nova-compute[74507]:     <partition>/machine</partition>
Oct 25 22:49:26 user nova-compute[74507]:   </resource>
Oct 25 22:49:26 user nova-compute[74507]:   <sysinfo type='smbios'>
Oct 25 22:49:26 user nova-compute[74507]:     <system>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='version'>0.0.0</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='serial'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='uuid'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='family'>Virtual Machine</entry>
Oct 25 22:49:26 user nova-compute[74507]:     </system>
Oct 25 22:49:26 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:26 user nova-compute[74507]:   <os>
Oct 25 22:49:26 user nova-compute[74507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 22:49:26 user nova-compute[74507]:     <boot dev='hd'/>
Oct 25 22:49:26 user nova-compute[74507]:     <smbios mode='sysinfo'/>
Oct 25 22:49:26 user nova-compute[74507]:   </os>
Oct 25 22:49:26 user nova-compute[74507]:   <features>
Oct 25 22:49:26 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:26 user nova-compute[74507]:     <apic/>
Oct 25 22:49:26 user nova-compute[74507]:     <vmcoreinfo state='on'/>
Oct 25 22:49:26 user nova-compute[74507]:   </features>
Oct 25 22:49:26 user nova-compute[74507]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 22:49:26 user nova-compute[74507]:     <model fallback='forbid'>Nehalem</model>
Oct 25 22:49:26 user nova-compute[74507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='vme'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='x2apic'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='hypervisor'/>
Oct 25 22:49:26 user nova-compute[74507]:   </cpu>
Oct 25 22:49:26 user nova-compute[74507]:   <clock offset='utc'>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='hpet' present='no'/>
Oct 25 22:49:26 user nova-compute[74507]:   </clock>
Oct 25 22:49:26 user nova-compute[74507]:   <on_poweroff>destroy</on_poweroff>
Oct 25 22:49:26 user nova-compute[74507]:   <on_reboot>restart</on_reboot>
Oct 25 22:49:26 user nova-compute[74507]:   <on_crash>destroy</on_crash>
Oct 25 22:49:26 user nova-compute[74507]:   <devices>
Oct 25 22:49:26 user nova-compute[74507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 22:49:26 user nova-compute[74507]:     <disk type='file' device='disk'>
Oct 25 22:49:26 user nova-compute[74507]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 22:49:26 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk' index='2'/>
Oct 25 22:49:26 user nova-compute[74507]:       <backingStore type='file' index='3'>
Oct 25 22:49:26 user nova-compute[74507]:         <format type='raw'/>
Oct 25 22:49:26 user nova-compute[74507]:         <source file='/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab'/>
Oct 25 22:49:26 user nova-compute[74507]:         <backingStore/>
Oct 25 22:49:26 user nova-compute[74507]:       </backingStore>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='vda' bus='virtio'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='virtio-disk0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </disk>
Oct 25 22:49:26 user nova-compute[74507]:     <disk type='file' device='cdrom'>
Oct 25 22:49:26 user nova-compute[74507]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 22:49:26 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config' index='1'/>
Oct 25 22:49:26 user nova-compute[74507]:       <backingStore/>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='hda' bus='ide'/>
Oct 25 22:49:26 user nova-compute[74507]:       <readonly/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='ide0-0-0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </disk>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='usb' index='0' model='none'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='usb'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='pci.0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='ide' index='0'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='ide'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <interface type='ethernet'>
Oct 25 22:49:26 user nova-compute[74507]:       <mac address='fa:16:3e:c9:0d:47'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='tap5c7f140a-fa'/>
Oct 25 22:49:26 user nova-compute[74507]:       <model type='virtio'/>
Oct 25 22:49:26 user nova-compute[74507]:       <mtu size='1442'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='net0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </interface>
Oct 25 22:49:26 user nova-compute[74507]:     <serial type='pty'>
Oct 25 22:49:26 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:26 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target type='isa-serial' port='0'>
Oct 25 22:49:26 user nova-compute[74507]:         <model name='isa-serial'/>
Oct 25 22:49:26 user nova-compute[74507]:       </target>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </serial>
Oct 25 22:49:26 user nova-compute[74507]:     <console type='pty' tty='/dev/pts/8'>
Oct 25 22:49:26 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:26 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target type='serial' port='0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </console>
Oct 25 22:49:26 user nova-compute[74507]:     <input type='mouse' bus='ps2'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='input0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </input>
Oct 25 22:49:26 user nova-compute[74507]:     <input type='keyboard' bus='ps2'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='input1'/>
Oct 25 22:49:26 user nova-compute[74507]:     </input>
Oct 25 22:49:26 user nova-compute[74507]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 25 22:49:26 user nova-compute[74507]:       <listen type='address' address='0.0.0.0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </graphics>
Oct 25 22:49:26 user nova-compute[74507]:     <audio id='1' type='none'/>
Oct 25 22:49:26 user nova-compute[74507]:     <video>
Oct 25 22:49:26 user nova-compute[74507]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='video0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </video>
Oct 25 22:49:26 user nova-compute[74507]:     <memballoon model='virtio'>
Oct 25 22:49:26 user nova-compute[74507]:       <stats period='10'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='balloon0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:26 user nova-compute[74507]:     <rng model='virtio'>
Oct 25 22:49:26 user nova-compute[74507]:       <backend model='random'>/dev/urandom</backend>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='rng0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </rng>
Oct 25 22:49:26 user nova-compute[74507]:   </devices>
Oct 25 22:49:26 user nova-compute[74507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 22:49:26 user nova-compute[74507]:     <label>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</label>
Oct 25 22:49:26 user nova-compute[74507]:     <imagelabel>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</imagelabel>
Oct 25 22:49:26 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:26 user nova-compute[74507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 22:49:26 user nova-compute[74507]:     <label>+64055:+108</label>
Oct 25 22:49:26 user nova-compute[74507]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 22:49:26 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:26 user nova-compute[74507]: </domain>
Oct 25 22:49:26 user nova-compute[74507]:  {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface> {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:94:e2"/><model type="virtio"/><mtu size="1442"/><target dev="tap50722c3b-59"/></interface>not found in domain: <domain type='kvm' id='9'>
Oct 25 22:49:26 user nova-compute[74507]:   <name>instance-00000009</name>
Oct 25 22:49:26 user nova-compute[74507]:   <uuid>05535d1f-7a9b-46e6-ba67-4709507a3ee4</uuid>
Oct 25 22:49:26 user nova-compute[74507]:   <metadata>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:26 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:49:25</nova:creationTime>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:26 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:26 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:26 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:26 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:26 user nova-compute[74507]:   </metadata>
Oct 25 22:49:26 user nova-compute[74507]:   <memory unit='KiB'>524288</memory>
Oct 25 22:49:26 user nova-compute[74507]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 22:49:26 user nova-compute[74507]:   <vcpu placement='static'>1</vcpu>
Oct 25 22:49:26 user nova-compute[74507]:   <resource>
Oct 25 22:49:26 user nova-compute[74507]:     <partition>/machine</partition>
Oct 25 22:49:26 user nova-compute[74507]:   </resource>
Oct 25 22:49:26 user nova-compute[74507]:   <sysinfo type='smbios'>
Oct 25 22:49:26 user nova-compute[74507]:     <system>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='version'>0.0.0</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='serial'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='uuid'>05535d1f-7a9b-46e6-ba67-4709507a3ee4</entry>
Oct 25 22:49:26 user nova-compute[74507]:       <entry name='family'>Virtual Machine</entry>
Oct 25 22:49:26 user nova-compute[74507]:     </system>
Oct 25 22:49:26 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:26 user nova-compute[74507]:   <os>
Oct 25 22:49:26 user nova-compute[74507]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 22:49:26 user nova-compute[74507]:     <boot dev='hd'/>
Oct 25 22:49:26 user nova-compute[74507]:     <smbios mode='sysinfo'/>
Oct 25 22:49:26 user nova-compute[74507]:   </os>
Oct 25 22:49:26 user nova-compute[74507]:   <features>
Oct 25 22:49:26 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:26 user nova-compute[74507]:     <apic/>
Oct 25 22:49:26 user nova-compute[74507]:     <vmcoreinfo state='on'/>
Oct 25 22:49:26 user nova-compute[74507]:   </features>
Oct 25 22:49:26 user nova-compute[74507]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 22:49:26 user nova-compute[74507]:     <model fallback='forbid'>Nehalem</model>
Oct 25 22:49:26 user nova-compute[74507]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='vme'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='x2apic'/>
Oct 25 22:49:26 user nova-compute[74507]:     <feature policy='require' name='hypervisor'/>
Oct 25 22:49:26 user nova-compute[74507]:   </cpu>
Oct 25 22:49:26 user nova-compute[74507]:   <clock offset='utc'>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 22:49:26 user nova-compute[74507]:     <timer name='hpet' present='no'/>
Oct 25 22:49:26 user nova-compute[74507]:   </clock>
Oct 25 22:49:26 user nova-compute[74507]:   <on_poweroff>destroy</on_poweroff>
Oct 25 22:49:26 user nova-compute[74507]:   <on_reboot>restart</on_reboot>
Oct 25 22:49:26 user nova-compute[74507]:   <on_crash>destroy</on_crash>
Oct 25 22:49:26 user nova-compute[74507]:   <devices>
Oct 25 22:49:26 user nova-compute[74507]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 22:49:26 user nova-compute[74507]:     <disk type='file' device='disk'>
Oct 25 22:49:26 user nova-compute[74507]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 22:49:26 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk' index='2'/>
Oct 25 22:49:26 user nova-compute[74507]:       <backingStore type='file' index='3'>
Oct 25 22:49:26 user nova-compute[74507]:         <format type='raw'/>
Oct 25 22:49:26 user nova-compute[74507]:         <source file='/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab'/>
Oct 25 22:49:26 user nova-compute[74507]:         <backingStore/>
Oct 25 22:49:26 user nova-compute[74507]:       </backingStore>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='vda' bus='virtio'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='virtio-disk0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </disk>
Oct 25 22:49:26 user nova-compute[74507]:     <disk type='file' device='cdrom'>
Oct 25 22:49:26 user nova-compute[74507]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 22:49:26 user nova-compute[74507]:       <source file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk.config' index='1'/>
Oct 25 22:49:26 user nova-compute[74507]:       <backingStore/>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='hda' bus='ide'/>
Oct 25 22:49:26 user nova-compute[74507]:       <readonly/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='ide0-0-0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </disk>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='usb' index='0' model='none'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='usb'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='pci.0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <controller type='ide' index='0'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='ide'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 22:49:26 user nova-compute[74507]:     </controller>
Oct 25 22:49:26 user nova-compute[74507]:     <interface type='ethernet'>
Oct 25 22:49:26 user nova-compute[74507]:       <mac address='fa:16:3e:c9:0d:47'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target dev='tap5c7f140a-fa'/>
Oct 25 22:49:26 user nova-compute[74507]:       <model type='virtio'/>
Oct 25 22:49:26 user nova-compute[74507]:       <mtu size='1442'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='net0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </interface>
Oct 25 22:49:26 user nova-compute[74507]:     <serial type='pty'>
Oct 25 22:49:26 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:26 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target type='isa-serial' port='0'>
Oct 25 22:49:26 user nova-compute[74507]:         <model name='isa-serial'/>
Oct 25 22:49:26 user nova-compute[74507]:       </target>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </serial>
Oct 25 22:49:26 user nova-compute[74507]:     <console type='pty' tty='/dev/pts/8'>
Oct 25 22:49:26 user nova-compute[74507]:       <source path='/dev/pts/8'/>
Oct 25 22:49:26 user nova-compute[74507]:       <log file='/opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/console.log' append='off'/>
Oct 25 22:49:26 user nova-compute[74507]:       <target type='serial' port='0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='serial0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </console>
Oct 25 22:49:26 user nova-compute[74507]:     <input type='mouse' bus='ps2'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='input0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </input>
Oct 25 22:49:26 user nova-compute[74507]:     <input type='keyboard' bus='ps2'>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='input1'/>
Oct 25 22:49:26 user nova-compute[74507]:     </input>
Oct 25 22:49:26 user nova-compute[74507]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Oct 25 22:49:26 user nova-compute[74507]:       <listen type='address' address='0.0.0.0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </graphics>
Oct 25 22:49:26 user nova-compute[74507]:     <audio id='1' type='none'/>
Oct 25 22:49:26 user nova-compute[74507]:     <video>
Oct 25 22:49:26 user nova-compute[74507]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='video0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </video>
Oct 25 22:49:26 user nova-compute[74507]:     <memballoon model='virtio'>
Oct 25 22:49:26 user nova-compute[74507]:       <stats period='10'/>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='balloon0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:26 user nova-compute[74507]:     <rng model='virtio'>
Oct 25 22:49:26 user nova-compute[74507]:       <backend model='random'>/dev/urandom</backend>
Oct 25 22:49:26 user nova-compute[74507]:       <alias name='rng0'/>
Oct 25 22:49:26 user nova-compute[74507]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 22:49:26 user nova-compute[74507]:     </rng>
Oct 25 22:49:26 user nova-compute[74507]:   </devices>
Oct 25 22:49:26 user nova-compute[74507]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 22:49:26 user nova-compute[74507]:     <label>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</label>
Oct 25 22:49:26 user nova-compute[74507]:     <imagelabel>libvirt-05535d1f-7a9b-46e6-ba67-4709507a3ee4</imagelabel>
Oct 25 22:49:26 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:26 user nova-compute[74507]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 22:49:26 user nova-compute[74507]:     <label>+64055:+108</label>
Oct 25 22:49:26 user nova-compute[74507]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 22:49:26 user nova-compute[74507]:   </seclabel>
Oct 25 22:49:26 user nova-compute[74507]: </domain>
Oct 25 22:49:26 user nova-compute[74507]:  {{(pid=74507) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 22:49:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Detaching interface fa:16:3e:fc:94:e2 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap50722c3b-59' not found.
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Converting VIF {"id": "50722c3b-5921-4cb9-ad90-e07a8d534500", "address": "fa:16:3e:fc:94:e2", "network": {"id": "f2e21642-3d35-49d5-9457-932855b466cc", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1428594106", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50722c3b-59", "ovs_interfaceid": "50722c3b-5921-4cb9-ad90-e07a8d534500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG os_vif [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50722c3b-59, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:49:26 user nova-compute[74507]: INFO os_vif [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=50722c3b-5921-4cb9-ad90-e07a8d534500,network=Network(f2e21642-3d35-49d5-9457-932855b466cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50722c3b-59')
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [req-82a21ba0-02e7-4bca-b182-b99f30aa075b req-92ddd21e-e128-4928-a4e6-756e97c01104 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:26 user nova-compute[74507]:   <nova:package version="0.0.0"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:name>tempest-device-tagging-server-1323811657</nova:name>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:creationTime>2023-10-25 22:49:26</nova:creationTime>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:flavor name="m1.tiny">
Oct 25 22:49:26 user nova-compute[74507]:     <nova:memory>512</nova:memory>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:disk>1</nova:disk>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:swap>0</nova:swap>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:flavor>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:user uuid="d641f86e0cb84147bfa1be85f62dcacd">tempest-TaggedAttachmentsTest-339637805-project-member</nova:user>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:project uuid="344fd16a6c1b439b8e1699dba8d809d7">tempest-TaggedAttachmentsTest-339637805</nova:project>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:owner>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:26 user nova-compute[74507]:   <nova:ports>
Oct 25 22:49:26 user nova-compute[74507]:     <nova:port uuid="5c7f140a-fa7b-4393-95bd-86a33cc31cc8">
Oct 25 22:49:26 user nova-compute[74507]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:49:26 user nova-compute[74507]:     </nova:port>
Oct 25 22:49:26 user nova-compute[74507]:   </nova:ports>
Oct 25 22:49:26 user nova-compute[74507]: </nova:instance>
Oct 25 22:49:26 user nova-compute[74507]:  {{(pid=74507) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk 1073741824" returned: 0 in 0.120s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [{"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Releasing lock "refresh_cache-05535d1f-7a9b-46e6-ba67-4709507a3ee4" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] No waiting events found dispatching network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:26 user nova-compute[74507]: WARNING nova.compute.manager [req-ad840099-a5ce-46be-b57f-ff9c02f2ee14 req-26cca570-e2fa-47eb-91db-e5d52c606590 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received unexpected event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa for instance with vm_state building and task_state spawning.
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ccc88c6-b5a0-4f4d-99ea-dcae145b2a54 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "interface-05535d1f-7a9b-46e6-ba67-4709507a3ee4-50722c3b-5921-4cb9-ad90-e07a8d534500" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.811s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:49:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:27 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Instance spawned successfully.
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Cannot resize image /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Ensure instance console log exists: /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:27 user nova-compute[74507]: INFO nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Successfully created port: 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:49:27 user nova-compute[74507]: INFO nova.compute.manager [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Took 6.88 seconds to build instance.
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129a24fd-1c6c-43fe-acfe-f3806be9c23c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.988s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Successfully updated port: 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating instance_info_cache with network_info: [{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-changed-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Refreshing instance network info cache due to event network-changed-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] Acquiring lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance network_info: |[{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] Acquired lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Refreshing network info cache for port 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start _get_guest_xml network_info=[{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:49:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-tempest.common.compute-instance-1438832574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'pci_devices' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:49:29 user nova-compute[74507]:   <uuid>07808568-ed98-469b-a7d7-f5791e93c535</uuid>
Oct 25 22:49:29 user nova-compute[74507]:   <name>instance-0000000d</name>
Oct 25 22:49:29 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:49:29 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:49:29 user nova-compute[74507]:   <metadata>
Oct 25 22:49:29 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:29 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:name>tempest-tempest.common.compute-instance-1438832574</nova:name>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:49:29</nova:creationTime>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:49:29 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:29 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:owner>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:user uuid="40a2834cde90449e8067ae627d799836">tempest-ServerActionsTestOtherA-1402899626-project-member</nova:user>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:project uuid="0bae88be410b4835bd2e0470ed90a895">tempest-ServerActionsTestOtherA-1402899626</nova:project>
Oct 25 22:49:29 user nova-compute[74507]:       </nova:owner>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:29 user nova-compute[74507]:       <nova:ports>
Oct 25 22:49:29 user nova-compute[74507]:         <nova:port uuid="1d8a8c8f-2240-4cbe-8a2f-915b0be10d76">
Oct 25 22:49:29 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 22:49:29 user nova-compute[74507]:         </nova:port>
Oct 25 22:49:29 user nova-compute[74507]:       </nova:ports>
Oct 25 22:49:29 user nova-compute[74507]:     </nova:instance>
Oct 25 22:49:29 user nova-compute[74507]:   </metadata>
Oct 25 22:49:29 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:49:29 user nova-compute[74507]:     <system>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="serial">07808568-ed98-469b-a7d7-f5791e93c535</entry>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="uuid">07808568-ed98-469b-a7d7-f5791e93c535</entry>
Oct 25 22:49:29 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:49:29 user nova-compute[74507]:     </system>
Oct 25 22:49:29 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:29 user nova-compute[74507]:   <os>
Oct 25 22:49:29 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:49:29 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:49:29 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:49:29 user nova-compute[74507]:   </os>
Oct 25 22:49:29 user nova-compute[74507]:   <features>
Oct 25 22:49:29 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:29 user nova-compute[74507]:     <apic/>
Oct 25 22:49:29 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:49:29 user nova-compute[74507]:   </features>
Oct 25 22:49:29 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:49:29 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:49:29 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:49:29 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:49:29 user nova-compute[74507]:   </clock>
Oct 25 22:49:29 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:49:29 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:49:29 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:49:29 user nova-compute[74507]:   </cpu>
Oct 25 22:49:29 user nova-compute[74507]:   <devices>
Oct 25 22:49:29 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:49:29 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:49:29 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk"/>
Oct 25 22:49:29 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:49:29 user nova-compute[74507]:     </disk>
Oct 25 22:49:29 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:49:29 user nova-compute[74507]:       <mac address="fa:16:3e:e7:7b:bc"/>
Oct 25 22:49:29 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:29 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:49:29 user nova-compute[74507]:       <target dev="tap1d8a8c8f-22"/>
Oct 25 22:49:29 user nova-compute[74507]:     </interface>
Oct 25 22:49:29 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:49:29 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/console.log" append="off"/>
Oct 25 22:49:29 user nova-compute[74507]:     </serial>
Oct 25 22:49:29 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:49:29 user nova-compute[74507]:     <video>
Oct 25 22:49:29 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:29 user nova-compute[74507]:     </video>
Oct 25 22:49:29 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:49:29 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:49:29 user nova-compute[74507]:     </rng>
Oct 25 22:49:29 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:49:29 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:49:29 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:49:29 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:29 user nova-compute[74507]:   </devices>
Oct 25 22:49:29 user nova-compute[74507]: </domain>
Oct 25 22:49:29 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-tempest.common.compute-instance-1438832574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG os_vif [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0cdf7fe-24b0-56d8-af48-43665c6ad2e0', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8a8c8f-22, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d8a8c8f-22, col_values=(('qos', UUID('9740342f-060a-488e-b905-33fabf84fbfc')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d8a8c8f-22, col_values=(('external_ids', {'iface-id': '1d8a8c8f-2240-4cbe-8a2f-915b0be10d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:7b:bc', 'vm-uuid': '07808568-ed98-469b-a7d7-f5791e93c535'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:29 user nova-compute[74507]: INFO os_vif [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22')
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:e7:7b:bc, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'flavor' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updated VIF entry in instance network info cache for port 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating instance_info_cache with network_info: [{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d57ec3d2-0264-4a0a-ac35-76372c818c69 req-73d1e3ed-d8e2-4142-b2be-84ded3305a1b service nova] Releasing lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:29 user nova-compute[74507]: INFO nova.compute.manager [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Attaching volume ea97423b-3596-4780-9ee1-50c4a1949c0e to /dev/vdb
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG os_brick.utils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dae8b5-ae83-4bdd-b13d-c88e7006a053]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0c198-f490-414c-bddb-6b13296dda71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede8b2e-5bf5-454f-a306-9e763b88f29c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538b01e-a7ff-4911-96cb-0af4b4e373ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:49:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:49:30 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069e4bc-66d6-4909-8b7d-84768c6f3888]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG os_brick.utils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating existing volume attachment record: c2dffe66-9990-4357-ad7a-5d91f3a90011 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:31 user nova-compute[74507]: WARNING nova.compute.manager [req-163c93ab-df87-423f-b3f6-85e8bf9f2f08 req-5d379b91-52cb-45e8-a08c-d80a3237e6bc service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state building and task_state spawning.
Oct 25 22:49:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:49:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:49:32 user nova-compute[74507]: INFO nova.compute.claims [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Claim successful on node user
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:33 user nova-compute[74507]: WARNING nova.compute.manager [req-3f6c8ba7-4a18-4004-a6e5-f514ce53b1fe req-15afbf63-1ac7-4c3b-9092-ff1bbf2d6ee2 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state building and task_state spawning.
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance spawned successfully.
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:49:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:49:33 user nova-compute[74507]: INFO nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Took 7.77 seconds to spawn the instance on the hypervisor.
Oct 25 22:49:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG nova.policy [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd3304f393f14ab79afd757ea5f32b5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc39403f96043cf828ea29145f20808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:49:34 user nova-compute[74507]: INFO nova.compute.manager [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Took 8.94 seconds to build instance.
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8910bd38-f23f-4632-b616-2f3ca91a2b88 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.087s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:49:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Creating image(s)
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "/opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "/opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Successfully created port: 4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.867s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:35 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:35 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.314716339111328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk 1073741824" returned: 0 in 0.077s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.952s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.235s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9ee2afc8-b278-4b64-ad08-213cc752a982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 12340c14-7420-436a-957e-a7570a6ffadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c3bfe169-a148-45da-ad61-4e3c25a4b7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Cannot resize image /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Successfully updated port: 4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquired lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-changed-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Refreshing instance network info cache due to event network-changed-4e763fdd-64ef-473a-8d1c-7db87f1540b0. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] Acquiring lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.998s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Updating instance_info_cache with network_info: [{"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Releasing lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Instance network_info: |[{"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] Acquired lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.neutron [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Refreshing network info cache for port 4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Start _get_guest_xml network_info=[{"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:49:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-403520831',display_name='tempest-VolumesAdminNegativeTest-server-403520831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-403520831',id=14,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-821ypakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:34Z,user_data=None,user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=c3bfe169-a148-45da-ad61-4e3c25a4b7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.objects.instance [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'pci_devices' on Instance uuid c3bfe169-a148-45da-ad61-4e3c25a4b7f7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 is timed out.
Oct 25 22:49:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Successfully detached device sdc from instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097 from the live domain config.
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhZzLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:36 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:49:36 user nova-compute[74507]:   <uuid>c3bfe169-a148-45da-ad61-4e3c25a4b7f7</uuid>
Oct 25 22:49:36 user nova-compute[74507]:   <name>instance-0000000e</name>
Oct 25 22:49:36 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:49:36 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:49:36 user nova-compute[74507]:   <metadata>
Oct 25 22:49:36 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:49:36 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:name>tempest-VolumesAdminNegativeTest-server-403520831</nova:name>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:49:36</nova:creationTime>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:49:36 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:49:36 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:owner>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:user uuid="dd3304f393f14ab79afd757ea5f32b5f">tempest-VolumesAdminNegativeTest-176792302-project-member</nova:user>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:project uuid="efc39403f96043cf828ea29145f20808">tempest-VolumesAdminNegativeTest-176792302</nova:project>
Oct 25 22:49:36 user nova-compute[74507]:       </nova:owner>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:49:36 user nova-compute[74507]:       <nova:ports>
Oct 25 22:49:36 user nova-compute[74507]:         <nova:port uuid="4e763fdd-64ef-473a-8d1c-7db87f1540b0">
Oct 25 22:49:36 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 22:49:36 user nova-compute[74507]:         </nova:port>
Oct 25 22:49:36 user nova-compute[74507]:       </nova:ports>
Oct 25 22:49:36 user nova-compute[74507]:     </nova:instance>
Oct 25 22:49:36 user nova-compute[74507]:   </metadata>
Oct 25 22:49:36 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:49:36 user nova-compute[74507]:     <system>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="serial">c3bfe169-a148-45da-ad61-4e3c25a4b7f7</entry>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="uuid">c3bfe169-a148-45da-ad61-4e3c25a4b7f7</entry>
Oct 25 22:49:36 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:49:36 user nova-compute[74507]:     </system>
Oct 25 22:49:36 user nova-compute[74507]:   </sysinfo>
Oct 25 22:49:36 user nova-compute[74507]:   <os>
Oct 25 22:49:36 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:49:36 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:49:36 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:49:36 user nova-compute[74507]:   </os>
Oct 25 22:49:36 user nova-compute[74507]:   <features>
Oct 25 22:49:36 user nova-compute[74507]:     <acpi/>
Oct 25 22:49:36 user nova-compute[74507]:     <apic/>
Oct 25 22:49:36 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:49:36 user nova-compute[74507]:   </features>
Oct 25 22:49:36 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:49:36 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:49:36 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:49:36 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:49:36 user nova-compute[74507]:   </clock>
Oct 25 22:49:36 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:49:36 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:49:36 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:49:36 user nova-compute[74507]:   </cpu>
Oct 25 22:49:36 user nova-compute[74507]:   <devices>
Oct 25 22:49:36 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:49:36 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:49:36 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk"/>
Oct 25 22:49:36 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:49:36 user nova-compute[74507]:     </disk>
Oct 25 22:49:36 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:49:36 user nova-compute[74507]:       <mac address="fa:16:3e:13:b8:d6"/>
Oct 25 22:49:36 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:36 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:49:36 user nova-compute[74507]:       <target dev="tap4e763fdd-64"/>
Oct 25 22:49:36 user nova-compute[74507]:     </interface>
Oct 25 22:49:36 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:49:36 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/console.log" append="off"/>
Oct 25 22:49:36 user nova-compute[74507]:     </serial>
Oct 25 22:49:36 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:49:36 user nova-compute[74507]:     <video>
Oct 25 22:49:36 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:49:36 user nova-compute[74507]:     </video>
Oct 25 22:49:36 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:49:36 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:49:36 user nova-compute[74507]:     </rng>
Oct 25 22:49:36 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:49:36 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:49:36 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:49:36 user nova-compute[74507]:     </memballoon>
Oct 25 22:49:36 user nova-compute[74507]:   </devices>
Oct 25 22:49:36 user nova-compute[74507]: </domain>
Oct 25 22:49:36 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-403520831',display_name='tempest-VolumesAdminNegativeTest-server-403520831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-403520831',id=14,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-821ypakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:34Z,user_data=None,user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=c3bfe169-a148-45da-ad61-4e3c25a4b7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_vif [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '431fb0d0-a4a4-5932-8719-60acf4a205da', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4972fbf-5375-41d8-8c04-c3c473f09d53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:49:36 user nova-compute[74507]: No targets found.
Oct 25 22:49:36 user nova-compute[74507]: iSNS:
Oct 25 22:49:36 user nova-compute[74507]: No targets found.
Oct 25 22:49:36 user nova-compute[74507]: STATIC:
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f
Oct 25 22:49:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:49:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:49:36 user nova-compute[74507]: FIRMWARE:
Oct 25 22:49:36 user nova-compute[74507]: No targets found.
Oct 25 22:49:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:49:36 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:49:36 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e763fdd-64, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e763fdd-64, col_values=(('qos', UUID('188e8c58-0696-4f7e-a1c1-431234954734')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e763fdd-64, col_values=(('external_ids', {'iface-id': '4e763fdd-64ef-473a-8d1c-7db87f1540b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b8:d6', 'vm-uuid': 'c3bfe169-a148-45da-ad61-4e3c25a4b7f7'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:36 user nova-compute[74507]: INFO os_vif [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64')
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc56d53-3db3-44c3-a997-96664657a4cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6ad1d-dfd6-4095-85c6-567563e98aa4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:37 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:37 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:37 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c1d5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] No VIF found with MAC fa:16:3e:13:b8:d6, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae828ff0-5cc4-4fa2-882d-37247dfc7da3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[590dd7b8-aecc-4739-8100-715394de8860]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ded24-b3b3-4207-8083-c6bfa6a290c3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3882cb-9abc-42bb-95ff-3fdf658c1d57]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab79df-5845-47f8-8eb2-9340bcc3cf03]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eddb985-c83c-49e8-ba29-f0bb7f2cc2fc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260]
Oct 25 22:49:37 user nova-compute[74507]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:37 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:020146d1-0dbe-4475-a4f8-d442867c072f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db42e76-b6d4-4158-ae3d-7be9bd6c7863]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] <== disconnect_volume: return (465ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Updated VIF entry in instance network info cache for port 4e763fdd-64ef-473a-8d1c-7db87f1540b0. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Updating instance_info_cache with network_info: [{"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-faf55f67-7e39-44ad-8313-81051142a6ff req-693637f1-c955-473a-9170-41c6951a5c07 service nova] Releasing lock "refresh_cache-c3bfe169-a148-45da-ad61-4e3c25a4b7f7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lazy-loading 'flavor' on Instance uuid c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e412d780-0ca5-489e-ab93-a9c1d11e7b65 tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.332s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] No waiting events found dispatching network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:38 user nova-compute[74507]: WARNING nova.compute.manager [req-9a768a23-8db0-4e90-b2a8-94df5a2e231d req-67388e78-9cad-4ce0-9af8-853947cc684d service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received unexpected event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 for instance with vm_state building and task_state spawning.
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:39 user nova-compute[74507]: INFO nova.compute.manager [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Terminating instance
Oct 25 22:49:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Instance destroyed successfully.
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lazy-loading 'resources' on Instance uuid c5fd8bd5-777f-4469-a2fb-34af2f2e2097 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-805085715',display_name='tempest-AttachSCSIVolumeTestJSON-server-805085715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-805085715',id=7,image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhU2dJgUCD4mHahDArPpkbI/sY05oe+9RoPNeH/3rPMoeTA8Q3VzBx/J8G1D9kPiif+3iDFbVRNYIu/5mACYzhSxg3w0lf7IYYmXDFF4aMP6E4EmvfgIHqpbhJU2HiyAg==',key_name='tempest-keypair-506469757',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf5653ecaa094452859ddf1d8e8a0646',ramdisk_id='',reservation_id='r-kjybpez2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c02b4555-f785-4279-8d32-4bb7392d7c0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-783955555',owner_user_name='tempest-AttachSCSIVolumeTestJSON-783955555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5956bd3dc93a487db0e2033556c74355',uuid=c5fd8bd5-777f-4469-a2fb-34af2f2e2097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converting VIF {"id": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "address": "fa:16:3e:d4:01:bf", "network": {"id": "23e14860-fe50-4a5e-8979-e7628f80dae0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1446946635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf5653ecaa094452859ddf1d8e8a0646", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7b60f6-5a", "ovs_interfaceid": "6e7b60f6-5aca-406d-a0b7-4448c01bb558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG os_vif [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7b60f6-5a, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54ee63c0-b5c9-49de-a386-b1f509526526) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: INFO os_vif [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:01:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e7b60f6-5aca-406d-a0b7-4448c01bb558,network=Network(23e14860-fe50-4a5e-8979-e7628f80dae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7b60f6-5a')
Oct 25 22:49:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Deleting instance files /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097_del
Oct 25 22:49:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Deletion of /opt/stack/data/nova/instances/c5fd8bd5-777f-4469-a2fb-34af2f2e2097_del complete
Oct 25 22:49:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:40 user nova-compute[74507]: INFO nova.compute.manager [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 25 22:49:40 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:49:40 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] No waiting events found dispatching network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:41 user nova-compute[74507]: WARNING nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received unexpected event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 for instance with vm_state building and task_state spawning.
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-unplugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] No waiting events found dispatching network-vif-unplugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-unplugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Acquiring lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] No waiting events found dispatching network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:41 user nova-compute[74507]: WARNING nova.compute.manager [req-b9fd082f-aa4d-4927-aeeb-583c7067d603 req-035ade29-a711-4331-8113-8717fc264dfe service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received unexpected event network-vif-plugged-6e7b60f6-5aca-406d-a0b7-4448c01bb558 for instance with vm_state active and task_state deleting.
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:49:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Instance spawned successfully.
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:49:41 user nova-compute[74507]: INFO nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Took 7.39 seconds to spawn the instance on the hypervisor.
Oct 25 22:49:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:49:41 user nova-compute[74507]: INFO nova.compute.manager [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Took 9.24 seconds to build instance.
Oct 25 22:49:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-def5b62b-0c7d-4611-8266-ac6c65707c6a tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.424s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:42 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:42 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Took 1.57 seconds to deallocate network for instance.
Oct 25 22:49:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:42 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:42 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.705s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:42 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Deleted allocations for instance c5fd8bd5-777f-4469-a2fb-34af2f2e2097
Oct 25 22:49:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10a0e0cd-f1f7-41de-bff3-730f4d60522d tempest-AttachSCSIVolumeTestJSON-783955555 tempest-AttachSCSIVolumeTestJSON-783955555-project-member] Lock "c5fd8bd5-777f-4469-a2fb-34af2f2e2097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.739s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-f26dca0b-b9c9-4957-81ba-b08b3fab2706 req-1d1786ed-c456-442c-a487-502a246018ef service nova] [instance: c5fd8bd5-777f-4469-a2fb-34af2f2e2097] Received event network-vif-deleted-6e7b60f6-5aca-406d-a0b7-4448c01bb558 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:53 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1accff6d-2843-4af3-b5a0-00fca38808b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:49:53 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49bdd9d-c3a7-4043-b1b9-ca52114b153f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92af1c-40df-42e3-aed4-45a1c807715a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de7aae-bf62-4934-8479-305fa2677848]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e84c0e-6314-4f72-a215-a2a4bc50526f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jICAgSwG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ba084-2dc2-4414-9b1c-6a977564240b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f08fa1-30d5-45d1-9a41-e5fbb09612bd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a55c3c-b9b5-4a5f-94cf-fe87ec7b8ed5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:49:53 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca25a27-b882-47bd-b28b-9e2c78052a6e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae253927-232d-4450-a540-cbcf95e1ceb1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:53 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4a938-5cc7-4bd2-8a34-8826d39b357a]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG nova.objects.instance [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'flavor' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:49:54 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:49:54 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:49:54 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:49:54 user nova-compute[74507]:   <serial>ea97423b-3596-4780-9ee1-50c4a1949c0e</serial>
Oct 25 22:49:54 user nova-compute[74507]: </disk>
Oct 25 22:49:54 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No VIF found with MAC fa:16:3e:bf:24:13, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:49:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-49fb7c06-9961-47b1-8a03-1e2013eac6d1 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.929s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:56 user nova-compute[74507]: INFO nova.compute.manager [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Terminating instance
Oct 25 22:49:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-unplugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-unplugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-7abe0b06-0f3d-4587-8025-ff44c54e5a7d req-c393815f-5836-4bcc-b6af-ea72c1cebb79 service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-unplugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Instance destroyed successfully.
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lazy-loading 'resources' on Instance uuid 05535d1f-7a9b-46e6-ba67-4709507a3ee4 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1323811657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1323811657',id=9,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8SJHYsCuDMQw6rM15pRfupkRDXRMKMHpMZxMw5PmXKV+niktUF+2LeoZV3458rZQVZNHLHw292IjdqmuLtHft6rjZz8VQ9+pL35wX46sXScljiDZiVKvI88OmiysHp1g==',key_name='tempest-keypair-64072531',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='344fd16a6c1b439b8e1699dba8d809d7',ramdisk_id='',reservation_id='r-yi5eu39k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-339637805',owner_user_name='tempest-TaggedAttachmentsTest-339637805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d641f86e0cb84147bfa1be85f62dcacd',uuid=05535d1f-7a9b-46e6-ba67-4709507a3ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converting VIF {"id": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "address": "fa:16:3e:c9:0d:47", "network": {"id": "6a4e7dad-a3dc-4d53-902b-0ec3206e7289", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-648395837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "344fd16a6c1b439b8e1699dba8d809d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f140a-fa", "ovs_interfaceid": "5c7f140a-fa7b-4393-95bd-86a33cc31cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_vif [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c7f140a-fa, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c549be0-b069-434f-80b6-e18c85ce74fe) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: INFO os_vif [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:47,bridge_name='br-int',has_traffic_filtering=True,id=5c7f140a-fa7b-4393-95bd-86a33cc31cc8,network=Network(6a4e7dad-a3dc-4d53-902b-0ec3206e7289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f140a-fa')
Oct 25 22:49:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Deleting instance files /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4_del
Oct 25 22:49:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Deletion of /opt/stack/data/nova/instances/05535d1f-7a9b-46e6-ba67-4709507a3ee4_del complete
Oct 25 22:49:57 user nova-compute[74507]: INFO nova.compute.manager [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'serial': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b'}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b', 'serial'} {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:49:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:49:57 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[707e4178-3b3b-4f1f-a379-4cccfd5fbd0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:49:57 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57c67c-36a1-432f-9d80-9a702773ae6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837] added
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e95211-fac6-4034-b88a-80fa833cf077]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c2f71-a2ad-4afa-8813-96cb2b8ef7f3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utJykYhV {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:57 user nova-compute[74507]: INFO nova.compute.manager [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Terminating instance
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utJykYhV" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af517c-3055-4f7b-b3d5-e47c824f0260]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utJykYhV'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[41605eb6-d467-41d4-a8b5-9399ec748cd5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f4e67-2c12-4e4e-83f3-4db78da09b58]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f9977-62a6-439b-9af5-3900c4db4a0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]
Oct 25 22:49:57 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d21926-ed61-4291-a95f-0b56b93cc87f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2504501-23cb-46b0-8fe1-cf341a5b248b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:49:57 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:49:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afbe1a6-8c0f-4d56-a442-951f2fb798be]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-unplugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] No waiting events found dispatching network-vif-unplugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-f01c63ac-35c6-4de5-b58a-c6257a01b840 req-f55281ef-24c8-4b80-a2da-d575ca8dd040 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-unplugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Took 0.85 seconds to deallocate network for instance.
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Instance destroyed successfully.
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lazy-loading 'resources' on Instance uuid 9ee2afc8-b278-4b64-ad08-213cc752a982 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1772166494',display_name='tempest-VolumesAssistedSnapshotsTest-server-1772166494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1772166494',id=10,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/Hp7lonyK0gNt2qrWVjxD3CaU/OWTLcY1N6SNf5r4BqEwSzHUmLoZfwyNc/Z+EZ3OE52NF8pXsaB03exkyAT3x5cnHOR4as1a2183sih5nWTZvxXYjxvrpXjHk3xiNwg==',key_name='tempest-keypair-814436689',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069f799af70c46e98a9d3a17d74d49f3',ramdisk_id='',reservation_id='r-rr7dz74a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1378003740',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1378003740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95a93ac4fa554292ad2ad9b3d64c30a1',uuid=9ee2afc8-b278-4b64-ad08-213cc752a982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converting VIF {"id": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "address": "fa:16:3e:96:63:b4", "network": {"id": "b8887f63-4e00-48cd-a2c6-54dae0d85d1a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-278053023-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "069f799af70c46e98a9d3a17d74d49f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22348a80-cc", "ovs_interfaceid": "22348a80-cc7e-4f85-b522-8ed4605e6e43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG os_vif [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22348a80-cc, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1635e05-194b-43ad-a27a-76fcd1d93284) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Stashing vm_state: active {{(pid=74507) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 22:49:58 user nova-compute[74507]: INFO os_vif [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:63:b4,bridge_name='br-int',has_traffic_filtering=True,id=22348a80-cc7e-4f85-b522-8ed4605e6e43,network=Network(b8887f63-4e00-48cd-a2c6-54dae0d85d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22348a80-cc')
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Deleting instance files /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982_del
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Deletion of /opt/stack/data/nova/instances/9ee2afc8-b278-4b64-ad08-213cc752a982_del complete
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.compute.manager [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.201s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.compute.claims [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Claim successful on node user
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Deleted allocations for instance 05535d1f-7a9b-46e6-ba67-4709507a3ee4
Oct 25 22:49:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23861616430313137', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861616430313137', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lazy-loading 'flavor' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:49:58 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating resource usage from migration 2080dbf7-f026-496d-9cbb-370ec52e8076
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] Acquiring lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] No waiting events found dispatching network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:58 user nova-compute[74507]: WARNING nova.compute.manager [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received unexpected event network-vif-plugged-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 for instance with vm_state deleted and task_state None.
Oct 25 22:49:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-76cddda7-dd2b-40b3-9c82-24ba70e39a0a req-117ee05a-c0c1-416d-95b3-8b5e3ad56f6f service nova] [instance: 05535d1f-7a9b-46e6-ba67-4709507a3ee4] Received event network-vif-deleted-5c7f140a-fa7b-4393-95bd-86a33cc31cc8 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a6f525a0-9d3c-48db-b109-d5b049699a09 tempest-TaggedAttachmentsTest-339637805 tempest-TaggedAttachmentsTest-339637805-project-member] Lock "05535d1f-7a9b-46e6-ba67-4709507a3ee4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:59 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Took 0.88 seconds to deallocate network for instance.
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.647s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:59 user nova-compute[74507]: INFO nova.compute.manager [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Migrating
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:59 user nova-compute[74507]: INFO nova.compute.rpcapi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] Acquiring lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] No waiting events found dispatching network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:49:59 user nova-compute[74507]: WARNING nova.compute.manager [req-2216accd-45dd-41d9-aa48-249a0da9f5ec req-39283d38-2fbf-4308-9098-afe8d7263000 service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received unexpected event network-vif-plugged-22348a80-cc7e-4f85-b522-8ed4605e6e43 for instance with vm_state deleted and task_state None.
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:49:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:00 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Deleted allocations for instance 9ee2afc8-b278-4b64-ad08-213cc752a982
Oct 25 22:50:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 236978176 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23eafb61-0e5a-42f3-ace7-500e010ce7a7 tempest-VolumesAssistedSnapshotsTest-1378003740 tempest-VolumesAssistedSnapshotsTest-1378003740-project-member] Lock "9ee2afc8-b278-4b64-ad08-213cc752a982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.328s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 297795584 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Starting migrate_disk_and_power_off {{(pid=74507) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-b7f4bdbd-2f80-4294-be8d-630a07e40fad req-2b2b4ecd-d211-4629-9c0e-2d9142e0888a service nova] [instance: 9ee2afc8-b278-4b64-ad08-213cc752a982] Received event network-vif-deleted-22348a80-cc7e-4f85-b522-8ed4605e6e43 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 423624704 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:01 user nova-compute[74507]: WARNING nova.compute.manager [req-352bb743-dee2-4d86-a193-09b3438fa271 req-d3607b9c-d16e-494d-8b20-cb730b3f52da service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state active and task_state resize_migrating.
Oct 25 22:50:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance destroyed successfully.
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:49:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41549664-f6, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 558891008 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7e695bd-ab46-4a43-ada0-299a838e8d59) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:01 user nova-compute[74507]: INFO os_vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:50:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:01 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d7895d-404c-4fb8-b84f-b725ef83367f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:01 user nova-compute[74507]: No targets found.
Oct 25 22:50:01 user nova-compute[74507]: iSNS:
Oct 25 22:50:01 user nova-compute[74507]: No targets found.
Oct 25 22:50:01 user nova-compute[74507]: STATIC:
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:01 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:01 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:01 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:01 user nova-compute[74507]: No targets found.
Oct 25 22:50:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:01 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:01 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05b60e-2ef1-4af1-ad56-ab6031db2022]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f5485f-af7a-490d-a502-9d8977fc080a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:01 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b643b2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1526278-fa1c-4e44-bc2e-e682ce981c9b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc2c4a1-0acb-4456-ba14-bade96d327bf]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58566b25-a964-49e2-9aa3-a31fe0986dba]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7145ec-1680-4fc2-ab54-1340eae5b3ea]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca822f0-27ab-4afd-ae45-ec699e23615e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b1a98-826d-46ac-aa54-f8fe65635f8d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:50:02 user nova-compute[74507]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a04fd48-7f43-4778-835f-7fdbce9b4d64]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== disconnect_volume: return (442ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 731906048 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_resize/disk /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 850395136 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "cp -r /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_resize/disk /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk" returned: 0 in 0.427s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_resize/disk.info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk.info {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "cp -r /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_resize/disk.info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk.info" returned: 0 in 0.053s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 970981376 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:03 user nova-compute[74507]: WARNING nova.compute.manager [req-15a8ba26-cc7f-46da-a6e4-02f0a249992c req-1999eac9-8749-4fc4-80ad-730bf1c568f2 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state active and task_state resize_migrating.
Oct 25 22:50:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHpWftwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '47091bba-a724-4790-af09-7c8e8211cf8b'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:03 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f3b6c-4e9b-4e03-ad47-c43800338bd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:03 user nova-compute[74507]: No targets found.
Oct 25 22:50:03 user nova-compute[74507]: iSNS:
Oct 25 22:50:03 user nova-compute[74507]: No targets found.
Oct 25 22:50:03 user nova-compute[74507]: STATIC:
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:03 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:03 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:03 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:03 user nova-compute[74507]: No targets found.
Oct 25 22:50:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:03 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:03 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed67cc9-c154-41b4-b5bd-c5f89f76d8f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc3b73d-72e6-4db8-9329-2df5fb5363b7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:04 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c629a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c41ac3-d499-43c8-a165-5d631474b3b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3583f0-9747-415d-bde8-859789bda687]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba18a3c-0aa6-48d2-b468-8545916c42a5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[61012313-26cb-4226-b082-1819efce427c]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acab4f0-5019-4e19-8f3c-86302c07ed9c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f08883-ddec-44b5-85ae-007e5202dc61]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260]
Oct 25 22:50:04 user nova-compute[74507]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47091bba-a724-4790-af09-7c8e8211cf8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b256ca-c16e-40f4-8f65-9229a05c2a34]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] <== disconnect_volume: return (342ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2db7899e-3a31-4fd6-aece-6cf9b669c96b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'serial'} {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: removing Cinder connection for volume 47091bba-a724-4790-af09-7c8e8211cf8b {{(pid=74507) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Port 41549664-f691-487a-b621-4498583fbb63 binding to destination host user is already ACTIVE {{(pid=74507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:50:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] swap_volume: Updating volume 47091bba-a724-4790-af09-7c8e8211cf8b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "utJykYhV", "auth_password": "Ah2cBFOSNpbTHK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "ee9806f9-4d2c-4681-9b2a-a07945b0e837"}, "status": "reserved", "instance": "2db7899e-3a31-4fd6-aece-6cf9b669c96b", "attached_at": "", "detached_at": "", "volume_id": "ee9806f9-4d2c-4681-9b2a-a07945b0e837", "serial": "ee9806f9-4d2c-4681-9b2a-a07945b0e837"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'no_device': None, 'attachment_id': '14d5612d-af40-4fce-b63b-9808585e1818'} {{(pid=74507) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a0df4adf-b875-4f1d-b112-1ef1002ca68c tempest-TestVolumeSwap-811095813 tempest-TestVolumeSwap-811095813-project-admin] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 42.373s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.utils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce6d2d-966a-47c5-9455-82439d76b1ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-changed-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing instance network info cache due to event network-changed-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] Acquiring lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] Acquired lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Refreshing network info cache for port 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f299b28-e86c-4b6b-8490-6bf7f8efe2b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[667052e2-6b09-4642-8ae1-8c813b924ecc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a45fe1-fd2a-4754-8c9c-abba059076d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:50:05 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:50:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b148a-6834-4ae2-a919-81e9a478fa2f]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG os_brick.utils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updated VIF entry in instance network info cache for port 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:50:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46b0e50e-95ed-4c52-8b2a-e65435f56a8c req-0916a34f-df17-49b9-a139-b4f0be84b02c service nova] Releasing lock "refresh_cache-12340c14-7420-436a-957e-a7570a6ffadc" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:06 user nova-compute[74507]: INFO nova.compute.manager [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Detaching volume ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:06 user nova-compute[74507]: INFO nova.virt.block_device [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Attempting to driver detach volume ee9806f9-4d2c-4681-9b2a-a07945b0e837 from mountpoint /dev/vdb
Oct 25 22:50:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Attempting to detach device vdb from instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:50:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:50:06 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:50:06 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:50:06 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:50:06 user nova-compute[74507]:   <serial>ee9806f9-4d2c-4681-9b2a-a07945b0e837</serial>
Oct 25 22:50:06 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:50:06 user nova-compute[74507]: </disk>
Oct 25 22:50:06 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:50:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Successfully detached device vdb from instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b from the persistent domain config.
Oct 25 22:50:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:50:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:50:06 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:50:06 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:50:06 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:50:06 user nova-compute[74507]:   <serial>ee9806f9-4d2c-4681-9b2a-a07945b0e837</serial>
Oct 25 22:50:06 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:50:06 user nova-compute[74507]: </disk>
Oct 25 22:50:06 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:07 user nova-compute[74507]: INFO nova.compute.manager [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Terminating instance
Oct 25 22:50:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a17ae7a0-5c3f-4d30-b57c-1bfafadefa34 req-c41ecd88-a47e-4c99-a89b-f15a1d4f4623 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-7d174be9-799f-4ec3-ba1a-1906796a43ae req-3334f836-46fa-430b-884a-7af66907e71a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6aa69c2-8136-4c76-8e7b-0ba7588dc1c8 req-ef2ddfb3-5767-4737-aa65-f38f6b1d439d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'info_cache' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Instance destroyed successfully.
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lazy-loading 'resources' on Instance uuid 12340c14-7420-436a-957e-a7570a6ffadc {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6970bdb7-84, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88a2289b-8ffe-457a-ad74-1595c2c0dc77) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:36:c2,bridge_name='br-int',has_traffic_filtering=True,id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa,network=Network(4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6970bdb7-84')
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap782dad1b-22, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d2d52c0-8079-4bbc-9be4-0bcbf4be71e6) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:3f:68,bridge_name='br-int',has_traffic_filtering=True,id=782dad1b-229f-4bd4-9a28-fb348bfc801a,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap782dad1b-22')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfec4791d-ab, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff131b01-7d1d-431c-b9db-27aee15f9f87) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:70:b7,bridge_name='br-int',has_traffic_filtering=True,id=fec4791d-ab24-4c6f-a396-d18f8197bc9e,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfec4791d-ab')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff0dfd8b-a7, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance destroyed successfully.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'resources' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e79bc5-63, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dcee5e0-6f4f-4aa5-86bf-093486ba01c8) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2993529c-d65e-4eac-9217-4caf0b0c3e97) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:75:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff0dfd8b-a746-44a4-9eea-df1f71183130,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0dfd8b-a7')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cca5ad3-f7, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-782dad1b-229f-4bd4-9a28-fb348bfc801a for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-782dad1b-229f-4bd4-9a28-fb348bfc801a for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-b02f9395-653f-453f-ba8a-e4e184646b1e for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-b02f9395-653f-453f-ba8a-e4e184646b1e for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-97569942-737f-4bcf-88e4-d2078ec77c34 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-8b2b4070-ffdb-4bb3-a40d-4f74803bbd9d req-62a07de0-890f-4a92-a1c5-8c9faca6b082 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-97569942-737f-4bcf-88e4-d2078ec77c34 for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb2963fe-55bb-463c-845e-b94125934b46) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:a2:30,bridge_name='br-int',has_traffic_filtering=True,id=7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae,network=Network(08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cca5ad3-f7')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff6720-bad3-4dd2-aa7a-3fcce0bff8da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]: iSNS:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]: STATIC:
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:10 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:10 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb02f9395-65, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64fca8f7-ace4-4c78-a9ac-ceabf39e4ccf) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[637204a5-eeb0-4464-b354-2afc9b08cd04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:91:9b,bridge_name='br-int',has_traffic_filtering=True,id=b02f9395-653f-453f-ba8a-e4e184646b1e,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02f9395-65')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272856876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272856876',id=11,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMnDBX/nzVXgOMMVSiwvJUWH1MNMHp+hJWFhmQ4oZCDVtL+sxzrWuOo1ksL82oCN3jW3hMnZQFl7y+XoWvDtACYyVjVhyzRUc6KKiEiBfmO0f7i7Xn76dbUjj/U1iZPew==',key_name='tempest-keypair-1701492927',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:48:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d482f428b6d49e0b2af74845e86d783',ramdisk_id='',reservation_id='r-2zu2vdw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-311311515',owner_user_name='tempest-TaggedBootDevicesTest-311311515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05e265c175d7422384c48db8e4d2fb3f',uuid=12340c14-7420-436a-957e-a7570a6ffadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converting VIF {"id": "97569942-737f-4bcf-88e4-d2078ec77c34", "address": "fa:16:3e:07:6c:f6", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97569942-73", "ovs_interfaceid": "97569942-737f-4bcf-88e4-d2078ec77c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97569942-73, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75f7c872-0407-428f-a1d9-d094e7fac72a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[294553e0-6a33-4925-b198-b8edc434f9a4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546ab400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:10 user nova-compute[74507]: INFO os_vif [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6c:f6,bridge_name='br-int',has_traffic_filtering=True,id=97569942-737f-4bcf-88e4-d2078ec77c34,network=Network(e94387b4-f24e-4b7d-b3db-5152c78e8832),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97569942-73')
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxoAitDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc8cd9-ddad-4df9-a58c-5897ba372336]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8af3f-9c5d-440c-a2bb-25db40480ab7]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[110511ad-f6c7-48fe-91ff-2f46b580ef53]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-fec4791d-ab24-4c6f-a396-d18f8197bc9e for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-unplugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-unplugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-e3f43146-b89c-409a-bfe3-b0a81a82c226 req-cb93dc83-3b43-4698-916c-612c02b15d6c service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-ff0dfd8b-a746-44a4-9eea-df1f71183130 for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c3daa-c256-457b-9a7d-483c8c860ffb]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a228f07-ef51-4764-9c30-da615b257f3f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] Acquiring lock "12340c14-7420-436a-957e-a7570a6ffadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] Lock "12340c14-7420-436a-957e-a7570a6ffadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] No waiting events found dispatching network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.compute.manager [req-142b958a-771b-474a-a728-ae641d33a280 req-7def5db7-c0e6-48de-99b1-8a86226c9923 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received unexpected event network-vif-plugged-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae for instance with vm_state active and task_state deleting.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e89a4a-e0d0-45cb-9a27-3c1eb4b1a523]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]
Oct 25 22:50:10 user nova-compute[74507]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3720ea7-0d5d-4e40-8c09-35509eabd4b3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== disconnect_volume: return (364ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.260s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start _get_guest_xml network_info=[{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77b2db78-fc84-4a14-bd0c-089345ecf77b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '85d61c17-cfbd-4e09-8bea-04b71f28b94f', 'attached_at': '', 'detached_at': '', 'volume_id': '52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'serial': '52746134-dd2f-4e6b-9b5f-8262ba49c8fa'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'numa_topology' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf155ad-f2ce-4abd-a994-53cfcaeae688]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]: iSNS:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]: STATIC:
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:10 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:10 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:10 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:10 user nova-compute[74507]: No targets found.
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:10 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:10 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0739f7-9661-48d0-9ba3-97cb7a67d415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e984e-80da-42c4-b1cc-91009091d3ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:10 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54696c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361'): ({'sdg'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Removing single pathed devices sdg {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[45462c93-11d6-4a7c-9548-c6494ed6df9d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1afd36-8e03-4a20-8933-ae2055dc9d06]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Flushing IO for device /dev/sdg {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9ed55-49b4-4dbc-950b-edaff00fa630]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9000a43-8309-4ff6-899c-ab051cf47d2e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6539113b-3edb-4eac-b542-ffae21fa1b11]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe3777-bf67-43f2-8d93-2e3177f583c5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260]
Oct 25 22:50:11 user nova-compute[74507]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05ec9b82-174a-427b-8fd5-d547c48a7361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5ed7d-915c-455f-81a4-d2294c260161]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== disconnect_volume: return (608ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.249s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:11 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:11 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhmgbFjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:11 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c811c0d-6cf6-4359-8943-82837c85bf56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:50:11 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519f39f-529f-4475-b706-828766bb0c0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa] added
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[92884692-07b9-44f5-aef9-6b7fc4ad70af]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcf2c83-843f-48dc-9649-cd4b27d47387]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrTNJdOs {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrTNJdOs" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0954dd-5dae-42a6-beab-5cdff496c833]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrTNJdOs'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a31f6-ebf6-4dbb-aace-7a342af2ab8f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[578477e0-03d1-486b-b40e-81115ad23ebd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c8450e-7f93-4555-8a13-2a9708a8d7f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]
Oct 25 22:50:11 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7ce20-abdd-4894-914c-cb1f1221d22a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d37aa-90c8-4117-8ac7-b688ea13dac2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:11 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca912b3-b530-4fdc-be34-c848b862e565]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:50:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '23130393063323633', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130393063323633', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.325s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e148dc7-7ad1-4541-8a7a-293e3c6f7d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]: iSNS:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]: STATIC:
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:12 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:12 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'pci_devices' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:50:12 user nova-compute[74507]:   <uuid>85d61c17-cfbd-4e09-8bea-04b71f28b94f</uuid>
Oct 25 22:50:12 user nova-compute[74507]:   <name>instance-00000005</name>
Oct 25 22:50:12 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:50:12 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:50:12 user nova-compute[74507]:   <metadata>
Oct 25 22:50:12 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:50:12 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeTestJSON-server-962271633</nova:name>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:50:10</nova:creationTime>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:50:12 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:50:12 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:owner>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:user uuid="62ab99f645064dacb32c07b5beae3f8f">tempest-AttachVolumeTestJSON-1587183484-project-member</nova:user>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:project uuid="0a9cb2b4089144f4b19cd0a3cba46a8e">tempest-AttachVolumeTestJSON-1587183484</nova:project>
Oct 25 22:50:12 user nova-compute[74507]:       </nova:owner>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:50:12 user nova-compute[74507]:       <nova:ports>
Oct 25 22:50:12 user nova-compute[74507]:         <nova:port uuid="76e79bc5-6314-4fde-bb5e-9541d1a48274">
Oct 25 22:50:12 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 22:50:12 user nova-compute[74507]:         </nova:port>
Oct 25 22:50:12 user nova-compute[74507]:       </nova:ports>
Oct 25 22:50:12 user nova-compute[74507]:     </nova:instance>
Oct 25 22:50:12 user nova-compute[74507]:   </metadata>
Oct 25 22:50:12 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:50:12 user nova-compute[74507]:     <system>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="serial">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="uuid">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:50:12 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:50:12 user nova-compute[74507]:     </system>
Oct 25 22:50:12 user nova-compute[74507]:   </sysinfo>
Oct 25 22:50:12 user nova-compute[74507]:   <os>
Oct 25 22:50:12 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:50:12 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:50:12 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:50:12 user nova-compute[74507]:   </os>
Oct 25 22:50:12 user nova-compute[74507]:   <features>
Oct 25 22:50:12 user nova-compute[74507]:     <acpi/>
Oct 25 22:50:12 user nova-compute[74507]:     <apic/>
Oct 25 22:50:12 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:50:12 user nova-compute[74507]:   </features>
Oct 25 22:50:12 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:50:12 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:50:12 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:50:12 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:50:12 user nova-compute[74507]:   </clock>
Oct 25 22:50:12 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:50:12 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:50:12 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:50:12 user nova-compute[74507]:   </cpu>
Oct 25 22:50:12 user nova-compute[74507]:   <devices>
Oct 25 22:50:12 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:50:12 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:50:12 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk"/>
Oct 25 22:50:12 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:50:12 user nova-compute[74507]:     </disk>
Oct 25 22:50:12 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:50:12 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:50:12 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 22:50:12 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:50:12 user nova-compute[74507]:       <serial>52746134-dd2f-4e6b-9b5f-8262ba49c8fa</serial>
Oct 25 22:50:12 user nova-compute[74507]:     </disk>
Oct 25 22:50:12 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:50:12 user nova-compute[74507]:       <mac address="fa:16:3e:e7:ff:6d"/>
Oct 25 22:50:12 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:12 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:50:12 user nova-compute[74507]:       <target dev="tap76e79bc5-63"/>
Oct 25 22:50:12 user nova-compute[74507]:     </interface>
Oct 25 22:50:12 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:50:12 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/console.log" append="off"/>
Oct 25 22:50:12 user nova-compute[74507]:     </serial>
Oct 25 22:50:12 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:50:12 user nova-compute[74507]:     <video>
Oct 25 22:50:12 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:12 user nova-compute[74507]:     </video>
Oct 25 22:50:12 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:50:12 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:50:12 user nova-compute[74507]:     </rng>
Oct 25 22:50:12 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:50:12 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:50:12 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:50:12 user nova-compute[74507]:     </memballoon>
Oct 25 22:50:12 user nova-compute[74507]:   </devices>
Oct 25 22:50:12 user nova-compute[74507]: </domain>
Oct 25 22:50:12 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a167b-ecbb-492b-8709-9cebc99d5279]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e93ea-0021-4313-9d6b-89f7d08ec128]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:12 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c (non-flash)
Oct 25 22:50:12 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:12 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b643b31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c'): ({'sdh'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Removing single pathed devices sdh {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce11df6-bc42-4139-9932-d63313a29c86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c5d36-c28f-453c-849e-fca0c93118ae]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Flushing IO for device /dev/sdh {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5e1e64-2881-4638-9faf-d8039e576e4b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a643081-bb66-4dfd-97e4-89b500ef246b]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] SCSI volumes sdh have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d9cc9a-59f9-49c7-8aaf-99b0f43dee87]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e67a6-c003-4656-a791-d50e983e1f42]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260]
Oct 25 22:50:12 user nova-compute[74507]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:12 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22fd7c60-6039-4867-8c93-12c01a712b9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a55207-6df7-44a3-bcdd-0758a853688e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== disconnect_volume: return (1714ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbsmDBaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:12 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d015d47-b784-4a83-a0a6-3e9b00855992]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]: iSNS:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]: STATIC:
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:12 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:12 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:12 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:12 user nova-compute[74507]: No targets found.
Oct 25 22:50:12 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:12 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:12 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22809a7a-d56b-4f8d-9799-fdf360390c69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88fc07-cef8-4211-92b6-11f6f8eec60e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:13 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:13 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:13 user nova-compute[74507]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef (non-flash)
Oct 25 22:50:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5465b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef'): ({'sdi'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Removing single pathed devices sdi {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130fd58-4e28-44bc-9dd5-f275d76c0539]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[83326811-80dd-4f94-98a7-3ea38c334b4f]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Flushing IO for device /dev/sdi {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd252b4-d55b-48b7-a92e-482fde429844]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc3514b-a597-42bb-9315-20ded33df0c5]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] SCSI volumes sdi have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef46c43-64a9-425c-9d7f-02656a15ec6d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a31c9c-aaea-4aaf-afb0-79d3eefafea4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260]
Oct 25 22:50:13 user nova-compute[74507]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ce87ce7-d13c-4b39-ac7e-a1baaf8f6bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83844ff-d6b2-4e7b-b66e-4f2b49109c51]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] <== disconnect_volume: return (368ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Deleting instance files /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc_del
Oct 25 22:50:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Deletion of /opt/stack/data/nova/instances/12340c14-7420-436a-957e-a7570a6ffadc_del complete
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Cannot resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'migration_context' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.objects.base [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG os_vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0979985-7805-57b4-9360-02c8ad84496a', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e79bc5-63, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e79bc5-63, col_values=(('qos', UUID('ac7d470c-209e-49a2-847d-06395f6cacec')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e79bc5-63, col_values=(('external_ids', {'iface-id': '76e79bc5-6314-4fde-bb5e-9541d1a48274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ff:6d', 'vm-uuid': '85d61c17-cfbd-4e09-8bea-04b71f28b94f'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:13 user nova-compute[74507]: INFO nova.compute.manager [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Took 5.54 seconds to destroy the instance on the hypervisor.
Oct 25 22:50:13 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:50:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:13 user nova-compute[74507]: INFO os_vif [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:50:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:15 user nova-compute[74507]: WARNING nova.compute.manager [req-43278444-4798-4dc3-9a53-4dab321ab624 req-85195ecb-5182-46dc-9abb-d34f1db61530 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state powering-on.
Oct 25 22:50:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-9b46e19e-10d1-4a38-be28-045bac5fbdab req-e3c40fb0-6fc3-4e77-850c-16bbd704f41a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-deleted-97569942-737f-4bcf-88e4-d2078ec77c34 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:15 user nova-compute[74507]: INFO nova.compute.manager [req-9b46e19e-10d1-4a38-be28-045bac5fbdab req-e3c40fb0-6fc3-4e77-850c-16bbd704f41a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Neutron deleted interface 97569942-737f-4bcf-88e4-d2078ec77c34; detaching it from the instance and deleting it from the info cache
Oct 25 22:50:15 user nova-compute[74507]: DEBUG nova.network.neutron [req-9b46e19e-10d1-4a38-be28-045bac5fbdab req-e3c40fb0-6fc3-4e77-850c-16bbd704f41a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "address": "fa:16:3e:6b:36:c2", "network": {"id": "4e0c6b6f-2e3f-4c99-b60a-8109a02cddf3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1199978299-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6970bdb7-84", "ovs_interfaceid": "6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-9b46e19e-10d1-4a38-be28-045bac5fbdab req-e3c40fb0-6fc3-4e77-850c-16bbd704f41a service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Detach interface failed, port_id=97569942-737f-4bcf-88e4-d2078ec77c34, reason: Instance 12340c14-7420-436a-957e-a7570a6ffadc could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:17 user nova-compute[74507]: INFO nova.compute.manager [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Rescuing
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:17 user nova-compute[74507]: WARNING nova.compute.manager [req-f4f7da9e-2055-4b13-a413-95630fc1c2b6 req-e5f7ba94-4000-498e-a7d7-da54188183c8 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state powering-on.
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-deleted-6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:17 user nova-compute[74507]: INFO nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Neutron deleted interface 6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa; detaching it from the instance and deleting it from the info cache
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b02f9395-653f-453f-ba8a-e4e184646b1e", "address": "fa:16:3e:fd:91:9b", "network": {"id": "e94387b4-f24e-4b7d-b3db-5152c78e8832", "bridge": "br-int", "label": "tempest-device-tagging-net2-1487766110", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02f9395-65", "ovs_interfaceid": "b02f9395-653f-453f-ba8a-e4e184646b1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:50:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance rebooted successfully.
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1bd33fa0-8826-47fc-b414-d966c1945722 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Detach interface failed, port_id=6970bdb7-842a-4cd7-bf74-1e4f7fbff3aa, reason: Instance 12340c14-7420-436a-957e-a7570a6ffadc could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-deleted-b02f9395-653f-453f-ba8a-e4e184646b1e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:17 user nova-compute[74507]: INFO nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Neutron deleted interface b02f9395-653f-453f-ba8a-e4e184646b1e; detaching it from the instance and deleting it from the info cache
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [{"id": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "address": "fa:16:3e:60:3f:68", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782dad1b-22", "ovs_interfaceid": "782dad1b-229f-4bd4-9a28-fb348bfc801a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "address": "fa:16:3e:76:70:b7", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfec4791d-ab", "ovs_interfaceid": "fec4791d-ab24-4c6f-a396-d18f8197bc9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "address": "fa:16:3e:19:75:d8", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0dfd8b-a7", "ovs_interfaceid": "ff0dfd8b-a746-44a4-9eea-df1f71183130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "address": "fa:16:3e:df:a2:30", "network": {"id": "08f5b4fa-3df1-4d2a-83f6-8a4e62b726e7", "bridge": "br-int", "label": "tempest-device-tagging-net1-323230100", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9d482f428b6d49e0b2af74845e86d783", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cca5ad3-f7", "ovs_interfaceid": "7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-9616e69b-e377-46fe-8085-7aaeb88b98eb req-164f385c-8c88-4fac-94e3-741c3a6a8b6d service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Detach interface failed, port_id=b02f9395-653f-453f-ba8a-e4e184646b1e, reason: Instance 12340c14-7420-436a-957e-a7570a6ffadc could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:17 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:18 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Took 4.56 seconds to deallocate network for instance.
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:18 user nova-compute[74507]: WARNING nova.compute.manager [req-fa4f47ef-3bd6-4ac2-8a47-64e755002a57 req-c7f3bf47-eff0-479e-ad45-564a035e818b service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state rescuing.
Oct 25 22:50:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance destroyed successfully.
Oct 25 22:50:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Attempting rescue
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 22:50:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Creating image(s)
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'trusted_certs' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue" returned: 0 in 0.056s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'migration_context' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.base [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<de04d5f3-1651-4661-bc81-390182180af3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start _get_guest_xml network_info=[{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:53:e2:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.base [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<de04d5f3-1651-4661-bc81-390182180af3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'numa_topology' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.base [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<de04d5f3-1651-4661-bc81-390182180af3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:18 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:18 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'vcpu_model' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.base [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<de04d5f3-1651-4661-bc81-390182180af3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851963803',display_name='tempest-ServerRescueNegativeTestJSON-server-1851963803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851963803',id=1,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-55d4youq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:45:42Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=de04d5f3-1651-4661-bc81-390182180af3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:53:e2:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:53:e2:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.objects.base [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<de04d5f3-1651-4661-bc81-390182180af3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:50:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:50:18 user nova-compute[74507]:   <uuid>de04d5f3-1651-4661-bc81-390182180af3</uuid>
Oct 25 22:50:18 user nova-compute[74507]:   <name>instance-00000001</name>
Oct 25 22:50:18 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:50:18 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:50:18 user nova-compute[74507]:   <metadata>
Oct 25 22:50:18 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:50:18 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1851963803</nova:name>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:50:18</nova:creationTime>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:50:18 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:50:18 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:owner>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:50:18 user nova-compute[74507]:       </nova:owner>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:50:18 user nova-compute[74507]:       <nova:ports>
Oct 25 22:50:18 user nova-compute[74507]:         <nova:port uuid="bffb64da-2a84-46a7-a0eb-383e1d71cf4f">
Oct 25 22:50:18 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 22:50:18 user nova-compute[74507]:         </nova:port>
Oct 25 22:50:18 user nova-compute[74507]:       </nova:ports>
Oct 25 22:50:18 user nova-compute[74507]:     </nova:instance>
Oct 25 22:50:18 user nova-compute[74507]:   </metadata>
Oct 25 22:50:18 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:50:18 user nova-compute[74507]:     <system>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="serial">de04d5f3-1651-4661-bc81-390182180af3</entry>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="uuid">de04d5f3-1651-4661-bc81-390182180af3</entry>
Oct 25 22:50:18 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:50:18 user nova-compute[74507]:     </system>
Oct 25 22:50:18 user nova-compute[74507]:   </sysinfo>
Oct 25 22:50:18 user nova-compute[74507]:   <os>
Oct 25 22:50:18 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:50:18 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:50:18 user nova-compute[74507]:   </os>
Oct 25 22:50:18 user nova-compute[74507]:   <features>
Oct 25 22:50:18 user nova-compute[74507]:     <acpi/>
Oct 25 22:50:18 user nova-compute[74507]:     <apic/>
Oct 25 22:50:18 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:50:18 user nova-compute[74507]:   </features>
Oct 25 22:50:18 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:50:18 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:50:18 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:50:18 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:50:18 user nova-compute[74507]:   </clock>
Oct 25 22:50:18 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:50:18 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:50:18 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:50:18 user nova-compute[74507]:   </cpu>
Oct 25 22:50:18 user nova-compute[74507]:   <devices>
Oct 25 22:50:18 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:50:18 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:50:18 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue"/>
Oct 25 22:50:18 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:50:18 user nova-compute[74507]:     </disk>
Oct 25 22:50:18 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:50:18 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:50:18 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk"/>
Oct 25 22:50:18 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:50:18 user nova-compute[74507]:     </disk>
Oct 25 22:50:18 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:50:18 user nova-compute[74507]:       <mac address="fa:16:3e:53:e2:24"/>
Oct 25 22:50:18 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:18 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:50:18 user nova-compute[74507]:       <target dev="tapbffb64da-2a"/>
Oct 25 22:50:18 user nova-compute[74507]:     </interface>
Oct 25 22:50:18 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:50:18 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/console.log" append="off"/>
Oct 25 22:50:18 user nova-compute[74507]:     </serial>
Oct 25 22:50:18 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:50:18 user nova-compute[74507]:     <video>
Oct 25 22:50:18 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:18 user nova-compute[74507]:     </video>
Oct 25 22:50:18 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:50:18 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:50:18 user nova-compute[74507]:     </rng>
Oct 25 22:50:18 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:50:18 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:50:18 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:50:18 user nova-compute[74507]:     </memballoon>
Oct 25 22:50:18 user nova-compute[74507]:   </devices>
Oct 25 22:50:18 user nova-compute[74507]: </domain>
Oct 25 22:50:18 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:50:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance destroyed successfully.
Oct 25 22:50:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:50:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:50:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:53:e2:24, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:50:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-9032f69a-970a-4114-bbb1-81043b423471 req-96ab1654-2aef-47a3-ae77-f4bc08f5e409 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-deleted-ff0dfd8b-a746-44a4-9eea-df1f71183130 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-9032f69a-970a-4114-bbb1-81043b423471 req-96ab1654-2aef-47a3-ae77-f4bc08f5e409 service nova] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Received event network-vif-deleted-7cca5ad3-f7eb-4ae3-b37c-426a6b6349ae {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:20 user nova-compute[74507]: WARNING nova.compute.manager [req-10ebbb72-d7b3-47b8-9e66-1e164446ba97 req-5d4c5b5e-84c1-4b32-be3f-d1766b9115a6 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state rescuing.
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:20 user nova-compute[74507]: INFO nova.compute.manager [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] [instance: 12340c14-7420-436a-957e-a7570a6ffadc] Took 2.83 seconds to detach 3 volumes for instance.
Oct 25 22:50:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:21 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:50:21 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:50:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:21 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Deleted allocations for instance 12340c14-7420-436a-957e-a7570a6ffadc
Oct 25 22:50:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ac8b1aa0-e378-4b67-a9bd-4df5dc7b98f2 tempest-TaggedBootDevicesTest-311311515 tempest-TaggedBootDevicesTest-311311515-project-member] Lock "12340c14-7420-436a-957e-a7570a6ffadc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.666s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:22 user nova-compute[74507]: WARNING nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state rescuing.
Oct 25 22:50:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:22 user nova-compute[74507]: WARNING nova.compute.manager [req-051e6448-bbe8-4abb-9202-3e4fdd1f530e req-652f323b-6c17-4ceb-a478-7fdce61667b5 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state rescuing.
Oct 25 22:50:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6159509d-f736-4782-bfd3-14f04daada53 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:50:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Starting finish_migration {{(pid=74507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 22:50:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Creating image(s)
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.290s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk. size=21474836480 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk 21474836480 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk 21474836480" returned: 0 in 0.046s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Ensure instance console log exists: /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start _get_guest_xml network_info=[{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f26169b1-79fc-4e27-9947-d193a350c668', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3c5361aa-2b96-4c06-b93b-009858e427f2', 'attached_at': '2023-10-25T22:50:25.000000', 'detached_at': '', 'volume_id': 'ea97423b-3596-4780-9ee1-50c4a1949c0e', 'serial': 'ea97423b-3596-4780-9ee1-50c4a1949c0e'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:50:25 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:25 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:25 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:25 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:25 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30379897-f29e-4833-8c95-1ddf35218e9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:50:25 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb556700-71a8-4b5f-a971-ce6b7189f104]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added
Oct 25 22:50:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759dc57-ed19-4e25-9479-5dbfc60719b0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8b4a7-8cb2-4811-be6a-af27589e6684]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bceba25-49ee-4318-8a70-659e8bba9212]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jICAgSwG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a1888-ef37-4737-bcde-ebfd61a681c0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c3023-5b2e-46e9-9fb4-e1b84fe265d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:26 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:26 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login" returned: 0 in 1.082s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc926a9-da89-47a9-b335-8caebbe902ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:50:27 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:27 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60539b-8d33-4945-b2d5-d04965f3c0ef]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad40060c-98b5-4192-ba6d-11017b175c0f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:27 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:27 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:27 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:27 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:27 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:27 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.321s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b5b248-3747-449b-9f13-8614df1c9bbf]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:27 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b is timed out.
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:50:27 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Successfully detached device vdb from instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b from the live domain config.
Oct 25 22:50:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utJykYhV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'ee9806f9-4d2c-4681-9b2a-a07945b0e837'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:50:27 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:50:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:50:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.364s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== connect_volume: return (2365ms) {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.998s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:50:28 user nova-compute[74507]:   <uuid>3c5361aa-2b96-4c06-b93b-009858e427f2</uuid>
Oct 25 22:50:28 user nova-compute[74507]:   <name>instance-00000004</name>
Oct 25 22:50:28 user nova-compute[74507]:   <memory>2097152</memory>
Oct 25 22:50:28 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:50:28 user nova-compute[74507]:   <metadata>
Oct 25 22:50:28 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:50:28 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherB-server-1672474875</nova:name>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:50:25</nova:creationTime>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:flavor name="m1.small">
Oct 25 22:50:28 user nova-compute[74507]:         <nova:memory>2048</nova:memory>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:disk>20</nova:disk>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:50:28 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:owner>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:user uuid="625b3a2950ec4561a10239c20a13f93e">tempest-ServerActionsTestOtherB-1115493463-project-member</nova:user>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:project uuid="ef98410fe55b43ed8778fc75104265b2">tempest-ServerActionsTestOtherB-1115493463</nova:project>
Oct 25 22:50:28 user nova-compute[74507]:       </nova:owner>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:50:28 user nova-compute[74507]:       <nova:ports>
Oct 25 22:50:28 user nova-compute[74507]:         <nova:port uuid="41549664-f691-487a-b621-4498583fbb63">
Oct 25 22:50:28 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:50:28 user nova-compute[74507]:         </nova:port>
Oct 25 22:50:28 user nova-compute[74507]:       </nova:ports>
Oct 25 22:50:28 user nova-compute[74507]:     </nova:instance>
Oct 25 22:50:28 user nova-compute[74507]:   </metadata>
Oct 25 22:50:28 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:50:28 user nova-compute[74507]:     <system>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="serial">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="uuid">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:50:28 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:50:28 user nova-compute[74507]:     </system>
Oct 25 22:50:28 user nova-compute[74507]:   </sysinfo>
Oct 25 22:50:28 user nova-compute[74507]:   <os>
Oct 25 22:50:28 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:50:28 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:50:28 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:50:28 user nova-compute[74507]:   </os>
Oct 25 22:50:28 user nova-compute[74507]:   <features>
Oct 25 22:50:28 user nova-compute[74507]:     <acpi/>
Oct 25 22:50:28 user nova-compute[74507]:     <apic/>
Oct 25 22:50:28 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:50:28 user nova-compute[74507]:   </features>
Oct 25 22:50:28 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:50:28 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:50:28 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:50:28 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:50:28 user nova-compute[74507]:   </clock>
Oct 25 22:50:28 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:50:28 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:50:28 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:50:28 user nova-compute[74507]:   </cpu>
Oct 25 22:50:28 user nova-compute[74507]:   <devices>
Oct 25 22:50:28 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:50:28 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:50:28 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk"/>
Oct 25 22:50:28 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:50:28 user nova-compute[74507]:     </disk>
Oct 25 22:50:28 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:50:28 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:50:28 user nova-compute[74507]:       <source dev="/dev/sdc"/>
Oct 25 22:50:28 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:50:28 user nova-compute[74507]:       <serial>ea97423b-3596-4780-9ee1-50c4a1949c0e</serial>
Oct 25 22:50:28 user nova-compute[74507]:     </disk>
Oct 25 22:50:28 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:50:28 user nova-compute[74507]:       <mac address="fa:16:3e:bf:24:13"/>
Oct 25 22:50:28 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:28 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:50:28 user nova-compute[74507]:       <target dev="tap41549664-f6"/>
Oct 25 22:50:28 user nova-compute[74507]:     </interface>
Oct 25 22:50:28 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:50:28 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/console.log" append="off"/>
Oct 25 22:50:28 user nova-compute[74507]:     </serial>
Oct 25 22:50:28 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:50:28 user nova-compute[74507]:     <video>
Oct 25 22:50:28 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:50:28 user nova-compute[74507]:     </video>
Oct 25 22:50:28 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:50:28 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:50:28 user nova-compute[74507]:     </rng>
Oct 25 22:50:28 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:50:28 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:50:28 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:50:28 user nova-compute[74507]:     </memballoon>
Oct 25 22:50:28 user nova-compute[74507]:   </devices>
Oct 25 22:50:28 user nova-compute[74507]: </domain>
Oct 25 22:50:28 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-945895027-network", "vif_mac": "fa:16:3e:bf:24:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[142cea67-f108-4e2e-b76f-c6638c93b0af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:50:28 user nova-compute[74507]: No targets found.
Oct 25 22:50:28 user nova-compute[74507]: iSNS:
Oct 25 22:50:28 user nova-compute[74507]: No targets found.
Oct 25 22:50:28 user nova-compute[74507]: STATIC:
Oct 25 22:50:28 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e
Oct 25 22:50:28 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:28 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:28 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:50:28 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:28 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:28 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837
Oct 25 22:50:28 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:50:28 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:50:28 user nova-compute[74507]: FIRMWARE:
Oct 25 22:50:28 user nova-compute[74507]: No targets found.
Oct 25 22:50:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:50:28 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:50:28 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09b386f-2497-5747-94ee-de89323ad385', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41549664-f6, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41549664-f6, col_values=(('qos', UUID('0b151a83-8c49-41fd-806c-f8ea6e388245')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41549664-f6, col_values=(('external_ids', {'iface-id': '41549664-f691-487a-b621-4498583fbb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:24:13', 'vm-uuid': '3c5361aa-2b96-4c06-b93b-009858e427f2'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c23c94d-1a04-4387-988d-31a68388542f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:28 user nova-compute[74507]: INFO os_vif [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b522f16-33eb-4789-a1a8-5697385a333f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:28 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:28 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 (non-flash)
Oct 25 22:50:28 user nova-compute[74507]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:50:28 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:50:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546aa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9853858-d562-4f95-af68-75b1b824cc23]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] No VIF found with MAC fa:16:3e:bf:24:13, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda7458-ab16-4315-a8fc-487052f8406c]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3dd30e-14e7-4bdc-9f98-304228545fee]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cbc26-785f-4285-b74d-fb8f586ee902]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07cacd0-8b0e-4bf6-90cf-d8c7efab6d3a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[627577fc-d168-44b7-917f-0efd17e94344]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260]
Oct 25 22:50:28 user nova-compute[74507]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837, portal: 172.16.0.220,3260] successful.
Oct 25 22:50:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9806f9-4d2c-4681-9b2a-a07945b0e837 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5e79d1-3b7a-4546-aac1-83ee184b9e44]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] <== disconnect_volume: return (1426ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:50:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lazy-loading 'flavor' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6815497-fe32-4103-84d4-7e349778edf2 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.163s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:30 user nova-compute[74507]: WARNING nova.compute.manager [req-af28e487-d134-40e7-9553-1763b60bc6da req-37fdf4d9-7716-4996-9914-9e9510eb48b3 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state active and task_state resize_finish.
Oct 25 22:50:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:32 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance running successfully.
Oct 25 22:50:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Failed to set time: agent not configured {{(pid=74507) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c4313227-2a59-4960-8cfa-bf925a0ebf21 tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] finish_migration finished successfully. {{(pid=74507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:32 user nova-compute[74507]: WARNING nova.compute.manager [req-9d83b4c6-1a8e-4a44-841f-d1d8aba575e1 req-422a4344-a5e2-47c9-89f7-a1802dd80965 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state active and task_state resize_finish.
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:50:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:50:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:50:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=25.272762298583984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Applying migration context for instance 3c5361aa-2b96-4c06-b93b-009858e427f2 as it has an incoming, in-progress migration 2080dbf7-f026-496d-9cbb-370ec52e8076. Migration status is finished {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 22:50:36 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating resource usage from migration 2080dbf7-f026-496d-9cbb-370ec52e8076
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c3bfe169-a148-45da-ad61-4e3c25a4b7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Migration 2080dbf7-f026-496d-9cbb-370ec52e8076 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:50:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:50:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:50:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:57 user nova-compute[74507]: INFO nova.compute.manager [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Terminating instance
Oct 25 22:50:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-unplugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] No waiting events found dispatching network-vif-unplugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-36934354-e77b-419b-bb88-5aabd5324bbe req-284e007e-8fd9-4290-b603-0e9f78bdecc0 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-unplugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Instance destroyed successfully.
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lazy-loading 'resources' on Instance uuid 2db7899e-3a31-4fd6-aece-6cf9b669c96b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-161006731',display_name='tempest-TestVolumeSwap-server-161006731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-161006731',id=8,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDFlNWA1eFu/We1dNm9owWoIJF/p2nD5c1aV8XksdLTqTfPtnT9ZgaHfkqcGkqpwFhm+nH88gdrjNKjHVAYJS5ldxX7+pcn9StNU+LSl74g63yIuCSheXzNFMNsQJf5Vg==',key_name='tempest-keypair-1320761101',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7edf40e6c434b09aafbb2aac44a70fe',ramdisk_id='',reservation_id='r-rfefrpgm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-840304522',owner_user_name='tempest-TestVolumeSwap-840304522-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f049158deee3409c821b3e18847139ad',uuid=2db7899e-3a31-4fd6-aece-6cf9b669c96b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converting VIF {"id": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "address": "fa:16:3e:3a:ae:5c", "network": {"id": "fec1a1c8-c8c7-489d-8933-d38b551204a9", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1809265000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7edf40e6c434b09aafbb2aac44a70fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3ba0dc-68", "ovs_interfaceid": "0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG os_vif [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d3ba0dc-68, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff68aa8-1c84-402c-aa0a-9fad2ea1bb53) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:50:58 user nova-compute[74507]: INFO os_vif [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:5c,bridge_name='br-int',has_traffic_filtering=True,id=0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53,network=Network(fec1a1c8-c8c7-489d-8933-d38b551204a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3ba0dc-68')
Oct 25 22:50:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Deleting instance files /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b_del
Oct 25 22:50:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Deletion of /opt/stack/data/nova/instances/2db7899e-3a31-4fd6-aece-6cf9b669c96b_del complete
Oct 25 22:50:58 user nova-compute[74507]: INFO nova.compute.manager [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 22:50:58 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:50:58 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:50:59 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Took 1.57 seconds to deallocate network for instance.
Oct 25 22:50:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] Acquiring lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] No waiting events found dispatching network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:50:59 user nova-compute[74507]: WARNING nova.compute.manager [req-df030a8a-d6ef-4a54-ba5a-dc2bc55e1c01 req-550a0ca0-2605-4ba5-8fb1-f5f7cb49b606 service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received unexpected event network-vif-plugged-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 for instance with vm_state active and task_state deleting.
Oct 25 22:50:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:50:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-8046a7d8-5615-4442-9d6a-a0dc27eadd61 req-82f6a9f3-1072-4840-9229-cf9d326dbb0f service nova] [instance: 2db7899e-3a31-4fd6-aece-6cf9b669c96b] Received event network-vif-deleted-0d3ba0dc-68db-4c07-b4da-2f9d95ed2b53 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:00 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:00 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:00 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Deleted allocations for instance 2db7899e-3a31-4fd6-aece-6cf9b669c96b
Oct 25 22:51:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3eae17ea-91e7-4572-9721-4dc4dbf2ebc3 tempest-TestVolumeSwap-840304522 tempest-TestVolumeSwap-840304522-project-member] Lock "2db7899e-3a31-4fd6-aece-6cf9b669c96b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing instance network info cache due to event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:51:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] Acquiring lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] Acquired lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:13 user nova-compute[74507]: INFO nova.compute.manager [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Attaching volume 662d7a74-584e-48be-b933-b1f210f54ff5 to /dev/vdb
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.utils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9ab9a-5ac5-4dbe-baca-e3d59386f2c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5c27d-35da-4f74-a867-21e92124d68b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c694cb8-9add-4720-87a0-a071b989d7b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee3413-1581-4e51-9b4e-842b3c40157f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:13 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:51:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd303fd0-3303-4c22-8097-f0c541e7104e]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG os_brick.utils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:13 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating existing volume attachment record: 8531e9b2-d04e-4638-832d-5ba098658d11 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:51:14 user nova-compute[74507]: DEBUG nova.network.neutron [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updated VIF entry in instance network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:51:14 user nova-compute[74507]: DEBUG nova.network.neutron [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aab4dbd2-d683-41c5-bf2f-ff471efa220f req-4ac1f4ef-108c-48ae-834b-f915d0b2ba11 service nova] Releasing lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-changed-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Refreshing instance network info cache due to event network-changed-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:51:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] Acquiring lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] Acquired lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Refreshing network info cache for port 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updated VIF entry in instance network info cache for port 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating instance_info_cache with network_info: [{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b2089923-0f80-47ce-8cd1-1621aa7b5545 req-d2099455-c086-46b1-a0f4-011302b38d18 service nova] Releasing lock "refresh_cache-07808568-ed98-469b-a7d7-f5791e93c535" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'flavor' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:17 user nova-compute[74507]: INFO nova.compute.manager [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attaching volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36 to /dev/vdb
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.utils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9d59e7-7107-44e3-8ea7-e01f9ea82790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dfa52d-ff05-4ddd-8c09-32fafe829784]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3166e-1e17-4c8c-adc1-de4578a30154]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d953b355-3dbb-433b-9b14-e1b5ad611434]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:17 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:51:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6e58a-f1e3-4b2e-b371-3deb039ccb69]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG os_brick.utils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:17 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating existing volume attachment record: 21020403-d0a5-4012-92dc-4e5f609d0e6a {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:51:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:51:19 user nova-compute[74507]: INFO nova.compute.claims [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Claim successful on node user
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:51:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:51:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG nova.policy [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d2d8917cc004c9b9efaee4a226d4374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b24efb14e4e4cb5bbd66e4cb95f8ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:51:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Creating image(s)
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "/opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "/opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "/opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.253s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.258s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk 1073741824" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Successfully created port: fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:51:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Cannot resize image /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Ensure instance console log exists: /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Successfully updated port: fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquired lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-changed-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Refreshing instance network info cache due to event network-changed-fe9f8da9-003e-4568-accb-67509146fef1. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:51:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] Acquiring lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Releasing lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Instance network_info: |[{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] Acquired lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Refreshing network info cache for port fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Start _get_guest_xml network_info=[{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:51:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-123315516',display_name='tempest-ServerStableDeviceRescueTest-server-123315516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-123315516',id=15,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpe2IRONnb0xgkJx6uZg38h61XSHtvO5NFx3sD3tfLVdKh+b1XxahLfXTVU4/jxSU10q4Wit0gwtTz14BSgjIGCtAtwmulcZYr+hNERiHFJ7YCDDeT7aurJbAm8t2TWbQ==',key_name='tempest-keypair-1491349958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b24efb14e4e4cb5bbd66e4cb95f8ab5',ramdisk_id='',reservation_id='r-5stnyukm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-993087249',owner_user_name='tempest-ServerStableDeviceRescueTest-993087249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d2d8917cc004c9b9efaee4a226d4374',uuid=cee2d99c-cce8-419f-91da-6523af9313de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converting VIF {"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lazy-loading 'pci_devices' on Instance uuid cee2d99c-cce8-419f-91da-6523af9313de {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:51:22 user nova-compute[74507]:   <uuid>cee2d99c-cce8-419f-91da-6523af9313de</uuid>
Oct 25 22:51:22 user nova-compute[74507]:   <name>instance-0000000f</name>
Oct 25 22:51:22 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:51:22 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:51:22 user nova-compute[74507]:   <metadata>
Oct 25 22:51:22 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:51:22 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-123315516</nova:name>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:51:22</nova:creationTime>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:51:22 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:51:22 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:owner>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:user uuid="6d2d8917cc004c9b9efaee4a226d4374">tempest-ServerStableDeviceRescueTest-993087249-project-member</nova:user>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:project uuid="8b24efb14e4e4cb5bbd66e4cb95f8ab5">tempest-ServerStableDeviceRescueTest-993087249</nova:project>
Oct 25 22:51:22 user nova-compute[74507]:       </nova:owner>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:51:22 user nova-compute[74507]:       <nova:ports>
Oct 25 22:51:22 user nova-compute[74507]:         <nova:port uuid="fe9f8da9-003e-4568-accb-67509146fef1">
Oct 25 22:51:22 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 22:51:22 user nova-compute[74507]:         </nova:port>
Oct 25 22:51:22 user nova-compute[74507]:       </nova:ports>
Oct 25 22:51:22 user nova-compute[74507]:     </nova:instance>
Oct 25 22:51:22 user nova-compute[74507]:   </metadata>
Oct 25 22:51:22 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:51:22 user nova-compute[74507]:     <system>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="serial">cee2d99c-cce8-419f-91da-6523af9313de</entry>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="uuid">cee2d99c-cce8-419f-91da-6523af9313de</entry>
Oct 25 22:51:22 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:51:22 user nova-compute[74507]:     </system>
Oct 25 22:51:22 user nova-compute[74507]:   </sysinfo>
Oct 25 22:51:22 user nova-compute[74507]:   <os>
Oct 25 22:51:22 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:51:22 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:51:22 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:51:22 user nova-compute[74507]:   </os>
Oct 25 22:51:22 user nova-compute[74507]:   <features>
Oct 25 22:51:22 user nova-compute[74507]:     <acpi/>
Oct 25 22:51:22 user nova-compute[74507]:     <apic/>
Oct 25 22:51:22 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:51:22 user nova-compute[74507]:   </features>
Oct 25 22:51:22 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:51:22 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:51:22 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:51:22 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:51:22 user nova-compute[74507]:   </clock>
Oct 25 22:51:22 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:51:22 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:51:22 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:51:22 user nova-compute[74507]:   </cpu>
Oct 25 22:51:22 user nova-compute[74507]:   <devices>
Oct 25 22:51:22 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:51:22 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:51:22 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk"/>
Oct 25 22:51:22 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:51:22 user nova-compute[74507]:     </disk>
Oct 25 22:51:22 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:51:22 user nova-compute[74507]:       <mac address="fa:16:3e:48:08:c9"/>
Oct 25 22:51:22 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:51:22 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:51:22 user nova-compute[74507]:       <target dev="tapfe9f8da9-00"/>
Oct 25 22:51:22 user nova-compute[74507]:     </interface>
Oct 25 22:51:22 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:51:22 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/console.log" append="off"/>
Oct 25 22:51:22 user nova-compute[74507]:     </serial>
Oct 25 22:51:22 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:51:22 user nova-compute[74507]:     <video>
Oct 25 22:51:22 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:51:22 user nova-compute[74507]:     </video>
Oct 25 22:51:22 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:51:22 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:51:22 user nova-compute[74507]:     </rng>
Oct 25 22:51:22 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:51:22 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:51:22 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:51:22 user nova-compute[74507]:     </memballoon>
Oct 25 22:51:22 user nova-compute[74507]:   </devices>
Oct 25 22:51:22 user nova-compute[74507]: </domain>
Oct 25 22:51:22 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-123315516',display_name='tempest-ServerStableDeviceRescueTest-server-123315516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-123315516',id=15,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpe2IRONnb0xgkJx6uZg38h61XSHtvO5NFx3sD3tfLVdKh+b1XxahLfXTVU4/jxSU10q4Wit0gwtTz14BSgjIGCtAtwmulcZYr+hNERiHFJ7YCDDeT7aurJbAm8t2TWbQ==',key_name='tempest-keypair-1491349958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b24efb14e4e4cb5bbd66e4cb95f8ab5',ramdisk_id='',reservation_id='r-5stnyukm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-993087249',owner_user_name='tempest-ServerStableDeviceRescueTest-993087249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d2d8917cc004c9b9efaee4a226d4374',uuid=cee2d99c-cce8-419f-91da-6523af9313de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converting VIF {"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG os_vif [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11cbafc7-cfaa-53ac-ab41-7d6473fea1f6', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9f8da9-00, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe9f8da9-00, col_values=(('qos', UUID('2f083148-a3ae-426d-b9ba-0193c277ab5a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe9f8da9-00, col_values=(('external_ids', {'iface-id': 'fe9f8da9-003e-4568-accb-67509146fef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:08:c9', 'vm-uuid': 'cee2d99c-cce8-419f-91da-6523af9313de'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:22 user nova-compute[74507]: INFO os_vif [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00')
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] No VIF found with MAC fa:16:3e:48:08:c9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updated VIF entry in instance network info cache for port fe9f8da9-003e-4568-accb-67509146fef1. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-895122a8-c86c-4511-9e5c-a20a1907e95a req-ab3dd1d5-b3f5-4aa6-a446-9da75b837b49 service nova] Releasing lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] No waiting events found dispatching network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:24 user nova-compute[74507]: WARNING nova.compute.manager [req-2945e9d3-a160-4564-9b72-d1255ea3b47d req-d4875105-22c2-4d00-b241-84e6a1a04ad2 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received unexpected event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 for instance with vm_state building and task_state spawning.
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] No waiting events found dispatching network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:26 user nova-compute[74507]: WARNING nova.compute.manager [req-bcb08ea9-cfa8-45ea-8a3c-5d8a9173180a req-45872cde-dbd5-4474-9dbf-26853b071148 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received unexpected event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 for instance with vm_state building and task_state spawning.
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:51:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Instance spawned successfully.
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:26 user nova-compute[74507]: INFO nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Took 6.78 seconds to spawn the instance on the hypervisor.
Oct 25 22:51:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:51:27 user nova-compute[74507]: INFO nova.compute.manager [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Took 8.07 seconds to build instance.
Oct 25 22:51:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9ef4c56-d3aa-4bed-9d7b-78bf43bd2046 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.196s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:51:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating instance_info_cache with network_info: [{"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a24bc0e5-a941-49ce-b5f4-36308b71620c" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:51:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZaQqfIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:36 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:36 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:36 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:51:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.322494506835938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ba01d-8352-4161-a115-c7bab85008ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:51:36 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4e958-67e2-4b45-99e7-8fc3f902db0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5] added
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a125a0-e889-4003-8c80-87b801b076d5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9dd88e-3e1a-4ac5-8564-3224645cfccd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZaQqfIn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZaQqfIn" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae96734-bdce-457e-af3b-6c9de259a959]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZaQqfIn'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Applying migration context for instance 3c5361aa-2b96-4c06-b93b-009858e427f2 as it has an incoming, in-progress migration 2080dbf7-f026-496d-9cbb-370ec52e8076. Migration status is finished {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 22:51:36 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating resource usage from migration 2080dbf7-f026-496d-9cbb-370ec52e8076
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9b53c4-0487-44b3-bad7-296929b49ba9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc8be9-d344-437d-b784-341b68d9fd53]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e16f88-45d9-46eb-810c-83cdc318cea8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260]
Oct 25 22:51:36 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260] successful.
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a749de9-d00c-4907-a0e4-01a95ba87ba5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e485582-527a-45a2-b113-b1577afc9603]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:36 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b208057-9691-498d-8c72-7c1b761d0469]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZaQqfIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c3bfe169-a148-45da-ad61-4e3c25a4b7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Migration 2080dbf7-f026-496d-9cbb-370ec52e8076 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 22:51:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.244s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23162376432643762', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162376432643762', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:51:37 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:51:37 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:51:37 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:51:37 user nova-compute[74507]:   <serial>662d7a74-584e-48be-b933-b1f210f54ff5</serial>
Oct 25 22:51:37 user nova-compute[74507]: </disk>
Oct 25 22:51:37 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No VIF found with MAC fa:16:3e:76:95:b6, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f0f49c6-e458-4696-b02a-6ef8f8fc214a tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.545s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:51:38 user nova-compute[74507]: INFO nova.compute.claims [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Claim successful on node user
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:51:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:51:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:51:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG nova.policy [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '218e1fab1ba746fb8f1f1d3aac76a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1852140ec949278f908d4282813506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:51:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Creating image(s)
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "/opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "/opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "/opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk 1073741824" returned: 0 in 0.046s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:51:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Cannot resize image /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Ensure instance console log exists: /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:40 user nova-compute[74507]: INFO nova.compute.manager [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Detaching volume 662d7a74-584e-48be-b933-b1f210f54ff5
Oct 25 22:51:40 user nova-compute[74507]: INFO nova.virt.block_device [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Attempting to driver detach volume 662d7a74-584e-48be-b933-b1f210f54ff5 from mountpoint /dev/vdb
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Attempting to detach device vdb from instance 734cab0d-b6c6-4a43-95fa-cdd885639464 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:51:40 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:51:40 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:51:40 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:51:40 user nova-compute[74507]:   <serial>662d7a74-584e-48be-b933-b1f210f54ff5</serial>
Oct 25 22:51:40 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:51:40 user nova-compute[74507]: </disk>
Oct 25 22:51:40 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Successfully created port: 50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:51:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully detached device vdb from instance 734cab0d-b6c6-4a43-95fa-cdd885639464 from the persistent domain config.
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 734cab0d-b6c6-4a43-95fa-cdd885639464 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:51:40 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:51:40 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:51:40 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:51:40 user nova-compute[74507]:   <serial>662d7a74-584e-48be-b933-b1f210f54ff5</serial>
Oct 25 22:51:40 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:51:40 user nova-compute[74507]: </disk>
Oct 25 22:51:40 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Successfully updated port: 50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquired lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-changed-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Refreshing instance network info cache due to event network-changed-50bbbfb3-ca42-4080-b184-9813aaf43c5d. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] Acquiring lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Updating instance_info_cache with network_info: [{"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Releasing lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Instance network_info: |[{"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] Acquired lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Refreshing network info cache for port 50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Start _get_guest_xml network_info=[{"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:51:41 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:41 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-233653405',display_name='tempest-VolumesActionsTest-instance-233653405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-233653405',id=16,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1852140ec949278f908d4282813506',ramdisk_id='',reservation_id='r-rq7b1y9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-18069715',owner_user_name='tempest-VolumesActionsTest-18069715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:39Z,user_data=None,user_id='218e1fab1ba746fb8f1f1d3aac76a64f',uuid=86c0d195-f282-4e93-8ebb-16f1ec73c8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converting VIF {"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.objects.instance [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lazy-loading 'pci_devices' on Instance uuid 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:51:41 user nova-compute[74507]:   <uuid>86c0d195-f282-4e93-8ebb-16f1ec73c8f6</uuid>
Oct 25 22:51:41 user nova-compute[74507]:   <name>instance-00000010</name>
Oct 25 22:51:41 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:51:41 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:51:41 user nova-compute[74507]:   <metadata>
Oct 25 22:51:41 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:51:41 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:name>tempest-VolumesActionsTest-instance-233653405</nova:name>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:51:41</nova:creationTime>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:51:41 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:51:41 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:owner>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:user uuid="218e1fab1ba746fb8f1f1d3aac76a64f">tempest-VolumesActionsTest-18069715-project-member</nova:user>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:project uuid="ae1852140ec949278f908d4282813506">tempest-VolumesActionsTest-18069715</nova:project>
Oct 25 22:51:41 user nova-compute[74507]:       </nova:owner>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:51:41 user nova-compute[74507]:       <nova:ports>
Oct 25 22:51:41 user nova-compute[74507]:         <nova:port uuid="50bbbfb3-ca42-4080-b184-9813aaf43c5d">
Oct 25 22:51:41 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 22:51:41 user nova-compute[74507]:         </nova:port>
Oct 25 22:51:41 user nova-compute[74507]:       </nova:ports>
Oct 25 22:51:41 user nova-compute[74507]:     </nova:instance>
Oct 25 22:51:41 user nova-compute[74507]:   </metadata>
Oct 25 22:51:41 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:51:41 user nova-compute[74507]:     <system>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="serial">86c0d195-f282-4e93-8ebb-16f1ec73c8f6</entry>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="uuid">86c0d195-f282-4e93-8ebb-16f1ec73c8f6</entry>
Oct 25 22:51:41 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:51:41 user nova-compute[74507]:     </system>
Oct 25 22:51:41 user nova-compute[74507]:   </sysinfo>
Oct 25 22:51:41 user nova-compute[74507]:   <os>
Oct 25 22:51:41 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:51:41 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:51:41 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:51:41 user nova-compute[74507]:   </os>
Oct 25 22:51:41 user nova-compute[74507]:   <features>
Oct 25 22:51:41 user nova-compute[74507]:     <acpi/>
Oct 25 22:51:41 user nova-compute[74507]:     <apic/>
Oct 25 22:51:41 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:51:41 user nova-compute[74507]:   </features>
Oct 25 22:51:41 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:51:41 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:51:41 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:51:41 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:51:41 user nova-compute[74507]:   </clock>
Oct 25 22:51:41 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:51:41 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:51:41 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:51:41 user nova-compute[74507]:   </cpu>
Oct 25 22:51:41 user nova-compute[74507]:   <devices>
Oct 25 22:51:41 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:51:41 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:51:41 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk"/>
Oct 25 22:51:41 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:51:41 user nova-compute[74507]:     </disk>
Oct 25 22:51:41 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:51:41 user nova-compute[74507]:       <mac address="fa:16:3e:6b:19:f9"/>
Oct 25 22:51:41 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:51:41 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:51:41 user nova-compute[74507]:       <target dev="tap50bbbfb3-ca"/>
Oct 25 22:51:41 user nova-compute[74507]:     </interface>
Oct 25 22:51:41 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:51:41 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/console.log" append="off"/>
Oct 25 22:51:41 user nova-compute[74507]:     </serial>
Oct 25 22:51:41 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:51:41 user nova-compute[74507]:     <video>
Oct 25 22:51:41 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:51:41 user nova-compute[74507]:     </video>
Oct 25 22:51:41 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:51:41 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:51:41 user nova-compute[74507]:     </rng>
Oct 25 22:51:41 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:51:41 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:51:41 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:51:41 user nova-compute[74507]:     </memballoon>
Oct 25 22:51:41 user nova-compute[74507]:   </devices>
Oct 25 22:51:41 user nova-compute[74507]: </domain>
Oct 25 22:51:41 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-233653405',display_name='tempest-VolumesActionsTest-instance-233653405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-233653405',id=16,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1852140ec949278f908d4282813506',ramdisk_id='',reservation_id='r-rq7b1y9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-18069715',owner_user_name='tempest-VolumesActionsTest-18069715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:39Z,user_data=None,user_id='218e1fab1ba746fb8f1f1d3aac76a64f',uuid=86c0d195-f282-4e93-8ebb-16f1ec73c8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converting VIF {"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG os_vif [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02e593cd-4717-5239-a499-9fb5576b643b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50bbbfb3-ca, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50bbbfb3-ca, col_values=(('qos', UUID('4edc124a-bc40-4444-938c-8907b0646310')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50bbbfb3-ca, col_values=(('external_ids', {'iface-id': '50bbbfb3-ca42-4080-b184-9813aaf43c5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:19:f9', 'vm-uuid': '86c0d195-f282-4e93-8ebb-16f1ec73c8f6'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:41 user nova-compute[74507]: INFO os_vif [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca')
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] No VIF found with MAC fa:16:3e:6b:19:f9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:41 user nova-compute[74507]: INFO nova.compute.manager [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Terminating instance
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Updated VIF entry in instance network info cache for port 50bbbfb3-ca42-4080-b184-9813aaf43c5d. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:51:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Updating instance_info_cache with network_info: [{"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99fdafbd-8655-4894-bbd3-f6762c8e46a0 req-cabfb21b-3773-41cf-a93e-05b5961d5e29 service nova] Releasing lock "refresh_cache-86c0d195-f282-4e93-8ebb-16f1ec73c8f6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Instance destroyed successfully.
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'resources' on Instance uuid c3bfe169-a148-45da-ad61-4e3c25a4b7f7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-403520831',display_name='tempest-VolumesAdminNegativeTest-server-403520831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-403520831',id=14,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-821ypakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:49:42Z,user_data=None,user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=c3bfe169-a148-45da-ad61-4e3c25a4b7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "address": "fa:16:3e:13:b8:d6", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e763fdd-64", "ovs_interfaceid": "4e763fdd-64ef-473a-8d1c-7db87f1540b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG os_vif [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e763fdd-64, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188e8c58-0696-4f7e-a1c1-431234954734) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: INFO os_vif [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b8:d6,bridge_name='br-int',has_traffic_filtering=True,id=4e763fdd-64ef-473a-8d1c-7db87f1540b0,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e763fdd-64')
Oct 25 22:51:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Deleting instance files /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7_del
Oct 25 22:51:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Deletion of /opt/stack/data/nova/instances/c3bfe169-a148-45da-ad61-4e3c25a4b7f7_del complete
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-unplugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] No waiting events found dispatching network-vif-unplugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-unplugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Acquiring lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] No waiting events found dispatching network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:43 user nova-compute[74507]: WARNING nova.compute.manager [req-b9903316-ea63-4850-b0da-46672d97b26d req-e6ded720-fd6e-44f5-b5d8-9500292f4356 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received unexpected event network-vif-plugged-4e763fdd-64ef-473a-8d1c-7db87f1540b0 for instance with vm_state active and task_state deleting.
Oct 25 22:51:43 user nova-compute[74507]: INFO nova.compute.manager [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 25 22:51:43 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:43 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:43 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Took 0.71 seconds to deallocate network for instance.
Oct 25 22:51:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:44 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Deleted allocations for instance c3bfe169-a148-45da-ad61-4e3c25a4b7f7
Oct 25 22:51:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b766ef2b-9961-48f9-91cf-fc618b9ac29c tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "c3bfe169-a148-45da-ad61-4e3c25a4b7f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] No waiting events found dispatching network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:45 user nova-compute[74507]: WARNING nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received unexpected event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d for instance with vm_state building and task_state spawning.
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: c3bfe169-a148-45da-ad61-4e3c25a4b7f7] Received event network-vif-deleted-4e763fdd-64ef-473a-8d1c-7db87f1540b0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] No waiting events found dispatching network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:45 user nova-compute[74507]: WARNING nova.compute.manager [req-c363b4ed-fbe8-4428-a649-435a16868fb1 req-bb7eafb0-caf7-499f-b400-be78bf5023f9 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received unexpected event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d for instance with vm_state building and task_state spawning.
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:51:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Instance spawned successfully.
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:51:45 user nova-compute[74507]: INFO nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Took 6.72 seconds to spawn the instance on the hypervisor.
Oct 25 22:51:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:51:45 user nova-compute[74507]: INFO nova.compute.manager [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Took 7.66 seconds to build instance.
Oct 25 22:51:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-340a8568-e23c-44a7-aee3-510455b8bccd tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.793s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Port 41549664-f691-487a-b621-4498583fbb63 binding to destination host user is already ACTIVE {{(pid=74507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid d5a1f112-41ec-401b-858a-86f213d3003b {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid cee2d99c-cce8-419f-91da-6523af9313de {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "de04d5f3-1651-4661-bc81-390182180af3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: INFO nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "cee2d99c-cce8-419f-91da-6523af9313de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Creating tmpfile /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/tmpr2gju2jw to verify with other compute node that the instance is on the same shared storage. {{(pid=74507) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 25 22:51:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "cee2d99c-cce8-419f-91da-6523af9313de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "de04d5f3-1651-4661-bc81-390182180af3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance destroyed successfully.
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.objects.instance [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'resources' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41549664-f6, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b151a83-8c49-41fd-806c-f8ea6e388245) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:49 user nova-compute[74507]: INFO os_vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:49 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:49 user nova-compute[74507]: WARNING nova.compute.manager [req-a4c3bce0-0eaa-42ac-9bf6-961afa216a9f req-77256808-3755-4f5e-93b1-c46336c7260e service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state resized and task_state resize_reverting.
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa438b6e-6cc4-48f3-8dc3-3d422d76ba4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:51:49 user nova-compute[74507]: No targets found.
Oct 25 22:51:49 user nova-compute[74507]: iSNS:
Oct 25 22:51:49 user nova-compute[74507]: No targets found.
Oct 25 22:51:49 user nova-compute[74507]: STATIC:
Oct 25 22:51:49 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e
Oct 25 22:51:49 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:49 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:49 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5
Oct 25 22:51:49 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:49 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:49 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8
Oct 25 22:51:49 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:49 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:49 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:51:49 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:49 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:49 user nova-compute[74507]: FIRMWARE:
Oct 25 22:51:49 user nova-compute[74507]: No targets found.
Oct 25 22:51:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:51:49 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:51:49 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a97ad65-0189-46d4-885d-5d3c916b2600]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65732c7c-381b-498b-9e5c-83047518e119]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8 (non-flash)
Oct 25 22:51:50 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:50 user nova-compute[74507]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af241a7f-3a51-4bf2-89ee-b59c4380ceb8 (non-flash)
Oct 25 22:51:50 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[123d5eaf-010c-4bd4-9679-665bcf0b0ea1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9548334-fe86-4afb-92bc-8cc3beb86257]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b69a050-4f27-4647-b79d-2c6ff3b9d3a1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64cf8ba-9375-44a0-9220-ec110e099ab3]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066e017-a69a-4f8e-a370-976a8bef2ddb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2c414-cac5-4b42-ad27-902e9bde1475]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:51:50 user nova-compute[74507]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:51:50 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c45139-765d-4539-a93f-ac43c08aba29]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== disconnect_volume: return (403ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:51:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG nova.objects.instance [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'migration_context' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG nova.objects.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Object Instance<3c5361aa-2b96-4c06-b93b-009858e427f2> lazy-loaded attributes: resources,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:51 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:51 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:51 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd7e47-0bf4-40d6-8475-261b03874c56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:51:51 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08ad745-635f-4ff4-a14a-66091d3aa6d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36] added
Oct 25 22:51:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26947ee-dc95-4e72-9072-3d03b49f42a1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c3616-4486-4bd3-bd5d-59077f02da94]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhdOazrE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhdOazrE" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48a2f88-b654-435a-8c50-a95eddd26f7e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LhdOazrE'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bef07d-ea82-4af2-bce3-4b508ada01ed]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[902ebb0e-7a99-4b1b-94e9-92a9630ff3d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:51 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:51 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:51 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c2388-d22e-4ecd-beb8-beb415d5d42e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]
Oct 25 22:51:52 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.
Oct 25 22:51:52 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:52 user nova-compute[74507]: WARNING nova.compute.manager [req-46cb4b3e-db3e-4792-9b05-10f97ae77a56 req-60eb5cad-b6da-4921-9417-83e2e48fe0dc service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state resized and task_state resize_reverting.
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52262218-80d0-4619-8813-02ddff213d6f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5a8cad-36f8-4550-9ce8-b01750004815]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:52 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:52 user nova-compute[74507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:51:52 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:52 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:52 user nova-compute[74507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:51:52 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.583s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1c033d-67c9-4d96-b76f-fcf1b1edf534]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:51:52 user nova-compute[74507]: INFO nova.compute.manager [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Swapping old allocation on dict_keys(['9922c2f0-2888-4d6d-8a23-61129bfd5ce8']) held by migration 2080dbf7-f026-496d-9cbb-370ec52e8076 for instance
Oct 25 22:51:52 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Overwriting current allocation {'allocations': {'9922c2f0-2888-4d6d-8a23-61129bfd5ce8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': 'ef98410fe55b43ed8778fc75104265b2', 'user_id': '625b3a2950ec4561a10239c20a13f93e', 'consumer_generation': 1} on consumer 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquired lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:51:52 user nova-compute[74507]: DEBUG nova.network.neutron [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23633643630633232', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633643630633232', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'flavor' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:51:53 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:51:53 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:51:53 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:51:53 user nova-compute[74507]:   <serial>a547c2ab-ba7b-41ea-9227-6dc4b4861b36</serial>
Oct 25 22:51:53 user nova-compute[74507]: </disk>
Oct 25 22:51:53 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Releasing lock "refresh_cache-3c5361aa-2b96-4c06-b93b-009858e427f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.utils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0de410-1e53-458f-a5f1-376b4cbda7e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1df226-8f5a-4ced-9a7e-68510d693d63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d49993-473d-4bbe-b5f5-ecbd8abfa1ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811e761-ead2-4abb-b1e2-006d7e61e7f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:53 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf72a7-26a9-415a-8393-bf10f219e9d3]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG os_brick.utils [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:e7:7b:bc, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1c24c98f-2847-4f69-a4b7-0102c76bfa3f tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.452s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.935s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:55 user nova-compute[74507]: INFO nova.compute.manager [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Rebuilding instance
Oct 25 22:51:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:55 user nova-compute[74507]: WARNING nova.compute.manager [req-e14150c6-e6b0-4704-b258-013df24e5861 req-aff31a74-3ab5-4b08-8dd4-97c5604e0744 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state active and task_state rebuilding.
Oct 25 22:51:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance destroyed successfully.
Oct 25 22:51:56 user nova-compute[74507]: INFO nova.compute.manager [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Detaching volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:51:56 user nova-compute[74507]: INFO nova.virt.block_device [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attempting to driver detach volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36 from mountpoint /dev/vdb
Oct 25 22:51:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Attempting to detach device vdb from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:51:56 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:51:56 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:51:56 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:51:56 user nova-compute[74507]:   <serial>a547c2ab-ba7b-41ea-9227-6dc4b4861b36</serial>
Oct 25 22:51:56 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:51:56 user nova-compute[74507]: </disk>
Oct 25 22:51:56 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:51:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully detached device vdb from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the persistent domain config.
Oct 25 22:51:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:56 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a6786-f4b3-4e0d-8afe-7b73ac10321f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:51:56 user nova-compute[74507]: No targets found.
Oct 25 22:51:56 user nova-compute[74507]: iSNS:
Oct 25 22:51:56 user nova-compute[74507]: No targets found.
Oct 25 22:51:56 user nova-compute[74507]: STATIC:
Oct 25 22:51:56 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:51:56 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:56 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:56 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5
Oct 25 22:51:56 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:56 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:56 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:51:56 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:56 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:56 user nova-compute[74507]: FIRMWARE:
Oct 25 22:51:56 user nova-compute[74507]: No targets found.
Oct 25 22:51:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:51:56 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:51:56 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9fa16d-09b0-4251-b769-4b6c93bdeab7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[98615204-70f3-468f-9bbb-8228c35f0298]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:56 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:56 user nova-compute[74507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:51:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:56 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:56 user nova-compute[74507]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:51:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64305750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57614f-4651-4fce-8503-c31f471ca453]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f702b0-e3da-464e-afee-5e547e76ec96]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[05145be3-e3e7-43f9-a858-bb5bde142b94]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:51:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f790c96-569e-4d76-94ac-8dc4f6158249]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88b5ec-21d8-4f65-ab9a-80a3f1a37484]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c8d003-544e-45eb-809c-fa1cc2d5a60a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]
Oct 25 22:51:57 user nova-compute[74507]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.
Oct 25 22:51:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02a5d3-5d0e-4dfa-96fa-4017ce2d1094]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== disconnect_volume: return (366ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:51:57 user nova-compute[74507]: DEBUG nova.compute.manager [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:51:57 user nova-compute[74507]: WARNING nova.compute.manager [req-3f71bd5a-d898-480a-ad89-a635fd8dd6c8 req-577dce9a-3caf-4f8f-b320-4ec8550655a6 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state active and task_state rebuilding.
Oct 25 22:51:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance destroyed successfully.
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-ServerActionsTestOtherA-server-38949155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8a8c8f-22, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9740342f-060a-488e-b905-33fabf84fbfc) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:51:58 user nova-compute[74507]: INFO os_vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22')
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e157a0-988a-4392-b2a4-3a67aca47b9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:51:58 user nova-compute[74507]: No targets found.
Oct 25 22:51:58 user nova-compute[74507]: iSNS:
Oct 25 22:51:58 user nova-compute[74507]: No targets found.
Oct 25 22:51:58 user nova-compute[74507]: STATIC:
Oct 25 22:51:58 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5
Oct 25 22:51:58 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:58 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:58 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:51:58 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:51:58 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:51:58 user nova-compute[74507]: FIRMWARE:
Oct 25 22:51:58 user nova-compute[74507]: No targets found.
Oct 25 22:51:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:51:58 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:51:58 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9540b1de-f7e4-434b-b95d-5836c3d89204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebe971-23a7-4596-815c-8e5e415b8b12]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:58 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:51:58 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:51:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420c310>, {}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Disconnecting from: [] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== disconnect_volume: return (84ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:51:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Deleting instance files /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535_del
Oct 25 22:51:58 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Deletion of /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535_del complete
Oct 25 22:51:58 user nova-compute[74507]: INFO nova.virt.block_device [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Booting with volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36 at /dev/vdb
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823d1db-4e13-4a49-8221-2f21b63be5bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796df90-9a03-4dad-91d7-4fb418e0c598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e089d35-048b-4082-8c0a-16b812c181c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c32c3-c402-4ade-be17-ff133aacf365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:51:58 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:51:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69250b5d-815f-451f-8b41-fdb240d54d34]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:51:58 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating existing volume attachment record: a2b28b2a-9175-4f6d-a35b-05456b8d7f39 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:00 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 734cab0d-b6c6-4a43-95fa-cdd885639464 is timed out.
Oct 25 22:52:00 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully detached device vdb from instance 734cab0d-b6c6-4a43-95fa-cdd885639464 from the live domain config.
Oct 25 22:52:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZaQqfIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:52:00 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95c979-4627-486d-9a14-2b5eed5d8baa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:52:00 user nova-compute[74507]: No targets found.
Oct 25 22:52:00 user nova-compute[74507]: iSNS:
Oct 25 22:52:00 user nova-compute[74507]: No targets found.
Oct 25 22:52:00 user nova-compute[74507]: STATIC:
Oct 25 22:52:00 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5
Oct 25 22:52:00 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:52:00 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:52:00 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:52:00 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:52:00 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:52:00 user nova-compute[74507]: FIRMWARE:
Oct 25 22:52:00 user nova-compute[74507]: No targets found.
Oct 25 22:52:00 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:52:00 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:52:00 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45cf55-3af7-4a96-bb1c-42af6990786e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4444f7-6a6d-4d0e-96be-2a17a1b86190]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:00 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:52:00 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:00 user nova-compute[74507]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 (non-flash)
Oct 25 22:52:00 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:52:00 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc7c70-b488-4a13-b55c-5b56226554d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5f6f75-230e-4055-bc36-8e82bd949db0]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f325061-e0bc-456b-addd-bad0cfd5d813]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde713a-2497-4b94-9c30-b377d89db25f]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[813d16ef-44ca-4a02-9f1b-c52784d0a63b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[715640e0-9be6-4b20-a287-9c575f7343c5]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260]
Oct 25 22:52:01 user nova-compute[74507]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5, portal: 172.16.0.220,3260] successful.
Oct 25 22:52:01 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:01 user nova-compute[74507]: INFO nova.compute.manager [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Detaching volume 52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:662d7a74-584e-48be-b933-b1f210f54ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fda1b8-9624-4668-a733-ba80729b2ea6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== disconnect_volume: return (343ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:52:01 user nova-compute[74507]: INFO nova.virt.block_device [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Attempting to driver detach volume 52746134-dd2f-4e6b-9b5f-8262ba49c8fa from mountpoint /dev/vdb
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Attempting to detach device vdb from instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:52:01 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:52:01 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 22:52:01 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:52:01 user nova-compute[74507]:   <serial>52746134-dd2f-4e6b-9b5f-8262ba49c8fa</serial>
Oct 25 22:52:01 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 22:52:01 user nova-compute[74507]: </disk>
Oct 25 22:52:01 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:52:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdb from instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f from the persistent domain config.
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:52:01 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:52:01 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 22:52:01 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:52:01 user nova-compute[74507]:   <serial>52746134-dd2f-4e6b-9b5f-8262ba49c8fa</serial>
Oct 25 22:52:01 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 22:52:01 user nova-compute[74507]: </disk>
Oct 25 22:52:01 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:52:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:52:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:08 user nova-compute[74507]: INFO nova.compute.manager [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Unrescuing
Oct 25 22:52:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG nova.objects.instance [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'flavor' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:09 user nova-compute[74507]: WARNING nova.compute.manager [req-a8471736-dc67-4aa9-af09-f6f637b8e242 req-7441795f-e4c0-4f8b-b3e7-53f383a7fecd service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:52:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance destroyed successfully.
Oct 25 22:52:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:11 user nova-compute[74507]: WARNING nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:52:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:11 user nova-compute[74507]: WARNING nova.compute.manager [req-628451e5-ae12-4ec2-984c-4f5e29e08cfc req-9e0e0dc7-0ba8-4076-8bd2-3af43a026d8a service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:52:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-39f4071f-e662-4ff7-986d-96a1a1df5640 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:13 user nova-compute[74507]: WARNING nova.compute.manager [req-31d1973e-f20f-4e21-834d-d270b0d3545f req-c2c0f5ae-909f-4ec4-91f0-c87a1fe2176d service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state active and task_state None.
Oct 25 22:52:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:13 user nova-compute[74507]: DEBUG nova.objects.instance [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-350b583b-2d16-414d-acd0-e66f975ac2d5 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.943s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 25.156s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Starting finish_revert_migration {{(pid=74507) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start _get_guest_xml network_info=[{"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c6b6fe74-f2e8-4efb-9fef-fdd473b9882a', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3c5361aa-2b96-4c06-b93b-009858e427f2', 'attached_at': '2023-10-25T22:52:14.000000', 'detached_at': '', 'volume_id': 'ea97423b-3596-4780-9ee1-50c4a1949c0e', 'serial': 'ea97423b-3596-4780-9ee1-50c4a1949c0e'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:52:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:52:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:14 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9d3ab7-b942-43ae-86fb-2ad0a64964ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:52:14 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[03052320-1922-472e-8465-e70d301a3566]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e] added
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabf476-38ed-4524-93ca-31c1ef86b281]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c82903-6bb3-4f9c-aab2-b1c516859f79]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jICAgSwG" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a7661-e96d-4a41-9be0-2aa158478374]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jICAgSwG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f9720-3e94-43ea-a71a-25ff589b3a02]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafed520-9da1-4ce1-9c88-c0e028deef9a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34fb788-fabb-4af4-bca9-2f68a7ad9348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:52:14 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[91702726-3367-4ffa-96ae-3d4e40c60f77]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3027fee6-9b5a-47e5-b78a-5f7e09d28dbc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:14 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:14 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179ca89-b17e-434a-9134-951e78dd87fc]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:52:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832346339333530', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:52:15 user nova-compute[74507]:   <uuid>3c5361aa-2b96-4c06-b93b-009858e427f2</uuid>
Oct 25 22:52:15 user nova-compute[74507]:   <name>instance-00000004</name>
Oct 25 22:52:15 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:52:15 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:52:15 user nova-compute[74507]:   <metadata>
Oct 25 22:52:15 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:52:15 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherB-server-1672474875</nova:name>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:52:14</nova:creationTime>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:52:15 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:52:15 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:owner>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:user uuid="625b3a2950ec4561a10239c20a13f93e">tempest-ServerActionsTestOtherB-1115493463-project-member</nova:user>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:project uuid="ef98410fe55b43ed8778fc75104265b2">tempest-ServerActionsTestOtherB-1115493463</nova:project>
Oct 25 22:52:15 user nova-compute[74507]:       </nova:owner>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:52:15 user nova-compute[74507]:       <nova:ports>
Oct 25 22:52:15 user nova-compute[74507]:         <nova:port uuid="41549664-f691-487a-b621-4498583fbb63">
Oct 25 22:52:15 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:52:15 user nova-compute[74507]:         </nova:port>
Oct 25 22:52:15 user nova-compute[74507]:       </nova:ports>
Oct 25 22:52:15 user nova-compute[74507]:     </nova:instance>
Oct 25 22:52:15 user nova-compute[74507]:   </metadata>
Oct 25 22:52:15 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:52:15 user nova-compute[74507]:     <system>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="serial">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="uuid">3c5361aa-2b96-4c06-b93b-009858e427f2</entry>
Oct 25 22:52:15 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:52:15 user nova-compute[74507]:     </system>
Oct 25 22:52:15 user nova-compute[74507]:   </sysinfo>
Oct 25 22:52:15 user nova-compute[74507]:   <os>
Oct 25 22:52:15 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:52:15 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:52:15 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:52:15 user nova-compute[74507]:   </os>
Oct 25 22:52:15 user nova-compute[74507]:   <features>
Oct 25 22:52:15 user nova-compute[74507]:     <acpi/>
Oct 25 22:52:15 user nova-compute[74507]:     <apic/>
Oct 25 22:52:15 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:52:15 user nova-compute[74507]:   </features>
Oct 25 22:52:15 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:52:15 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:52:15 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:52:15 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:52:15 user nova-compute[74507]:   </clock>
Oct 25 22:52:15 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:52:15 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:52:15 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:52:15 user nova-compute[74507]:   </cpu>
Oct 25 22:52:15 user nova-compute[74507]:   <devices>
Oct 25 22:52:15 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:52:15 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:52:15 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk"/>
Oct 25 22:52:15 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:52:15 user nova-compute[74507]:     </disk>
Oct 25 22:52:15 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:52:15 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:52:15 user nova-compute[74507]:       <source dev="/dev/sdc"/>
Oct 25 22:52:15 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:52:15 user nova-compute[74507]:       <serial>ea97423b-3596-4780-9ee1-50c4a1949c0e</serial>
Oct 25 22:52:15 user nova-compute[74507]:     </disk>
Oct 25 22:52:15 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:52:15 user nova-compute[74507]:       <mac address="fa:16:3e:bf:24:13"/>
Oct 25 22:52:15 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:15 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:52:15 user nova-compute[74507]:       <target dev="tap41549664-f6"/>
Oct 25 22:52:15 user nova-compute[74507]:     </interface>
Oct 25 22:52:15 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:52:15 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/console.log" append="off"/>
Oct 25 22:52:15 user nova-compute[74507]:     </serial>
Oct 25 22:52:15 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:52:15 user nova-compute[74507]:     <video>
Oct 25 22:52:15 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:15 user nova-compute[74507]:     </video>
Oct 25 22:52:15 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:52:15 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:52:15 user nova-compute[74507]:     </rng>
Oct 25 22:52:15 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:52:15 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:52:15 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:52:15 user nova-compute[74507]:     </memballoon>
Oct 25 22:52:15 user nova-compute[74507]:   </devices>
Oct 25 22:52:15 user nova-compute[74507]: </domain>
Oct 25 22:52:15 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG os_vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09b386f-2497-5747-94ee-de89323ad385', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41549664-f6, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41549664-f6, col_values=(('qos', UUID('5da35e0b-f581-4f9c-9a76-786a27f3d607')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41549664-f6, col_values=(('external_ids', {'iface-id': '41549664-f691-487a-b621-4498583fbb63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:24:13', 'vm-uuid': '3c5361aa-2b96-4c06-b93b-009858e427f2'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:15 user nova-compute[74507]: INFO os_vif [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:52:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:52:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Creating image(s)
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:18 user nova-compute[74507]: WARNING nova.compute.manager [req-931bfed0-acf5-4344-a1ad-feb45ff8a93c req-dc61bb64-2753-456d-add4-ff6cfdf12900 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state resized and task_state resize_reverting.
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.290s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.259s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk 1073741824" returned: 0 in 0.053s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:52:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Cannot resize image /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Ensure instance console log exists: /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start _get_guest_xml network_info=[{"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a2b28b2a-9175-4f6d-a35b-05456b8d7f39', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07808568-ed98-469b-a7d7-f5791e93c535', 'attached_at': '', 'detached_at': '', 'volume_id': 'a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'serial': 'a547c2ab-ba7b-41ea-9227-6dc4b4861b36'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:52:19 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 22:52:19 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:52:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:19 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dbc495-9ea6-4cc0-991f-3025876259a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:52:19 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda1505-a57b-4855-8b91-96cd42aeb98a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36] added
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c00b27-f8d0-4770-b7f6-80a94fd3d637]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc4ebf-b15a-4960-9d73-859a5ea170f5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhdOazrE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LhdOazrE" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce3f1b7-701b-47ab-9705-538a32a8f12f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LhdOazrE'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0224eb1-0add-47ca-8238-deb27d353f33]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8868c-371f-412f-a996-e57162fbb229]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c061f-2c05-438d-a0df-c8f8dc5e6eeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]
Oct 25 22:52:19 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3a11f3-e425-4ae6-98ab-208f5106bc79]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b1f79-ce7d-4d2f-ae22-5e9df9bceb0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:19 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:52:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf35b17-02d1-48c2-80de-e146d36cc0da]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:52:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:52:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance running successfully.
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] finish_revert_migration finished successfully. {{(pid=74507) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:20 user nova-compute[74507]: WARNING nova.compute.manager [req-5dedb87d-4517-4c90-ab3d-30730f254721 req-96917dc3-bd61-432c-ab53-c3dbd03ea319 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state resized and task_state resize_reverting.
Oct 25 22:52:20 user nova-compute[74507]: INFO nova.compute.manager [None req-76a83e81-c438-44ed-b71e-a68d3709f41c tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance to original state: 'active'
Oct 25 22:52:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23633643630633232', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633643630633232', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-ServerActionsTestOtherA-server-38949155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:52:20 user nova-compute[74507]:   <uuid>07808568-ed98-469b-a7d7-f5791e93c535</uuid>
Oct 25 22:52:20 user nova-compute[74507]:   <name>instance-0000000d</name>
Oct 25 22:52:20 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:52:20 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:52:20 user nova-compute[74507]:   <metadata>
Oct 25 22:52:20 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:52:20 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherA-server-38949155</nova:name>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:52:19</nova:creationTime>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:52:20 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:52:20 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:owner>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:user uuid="40a2834cde90449e8067ae627d799836">tempest-ServerActionsTestOtherA-1402899626-project-member</nova:user>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:project uuid="0bae88be410b4835bd2e0470ed90a895">tempest-ServerActionsTestOtherA-1402899626</nova:project>
Oct 25 22:52:20 user nova-compute[74507]:       </nova:owner>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:52:20 user nova-compute[74507]:       <nova:ports>
Oct 25 22:52:20 user nova-compute[74507]:         <nova:port uuid="1d8a8c8f-2240-4cbe-8a2f-915b0be10d76">
Oct 25 22:52:20 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 22:52:20 user nova-compute[74507]:         </nova:port>
Oct 25 22:52:20 user nova-compute[74507]:       </nova:ports>
Oct 25 22:52:20 user nova-compute[74507]:     </nova:instance>
Oct 25 22:52:20 user nova-compute[74507]:   </metadata>
Oct 25 22:52:20 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:52:20 user nova-compute[74507]:     <system>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="serial">07808568-ed98-469b-a7d7-f5791e93c535</entry>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="uuid">07808568-ed98-469b-a7d7-f5791e93c535</entry>
Oct 25 22:52:20 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:52:20 user nova-compute[74507]:     </system>
Oct 25 22:52:20 user nova-compute[74507]:   </sysinfo>
Oct 25 22:52:20 user nova-compute[74507]:   <os>
Oct 25 22:52:20 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:52:20 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:52:20 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:52:20 user nova-compute[74507]:   </os>
Oct 25 22:52:20 user nova-compute[74507]:   <features>
Oct 25 22:52:20 user nova-compute[74507]:     <acpi/>
Oct 25 22:52:20 user nova-compute[74507]:     <apic/>
Oct 25 22:52:20 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:52:20 user nova-compute[74507]:   </features>
Oct 25 22:52:20 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:52:20 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:52:20 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:52:20 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:52:20 user nova-compute[74507]:   </clock>
Oct 25 22:52:20 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:52:20 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:52:20 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:52:20 user nova-compute[74507]:   </cpu>
Oct 25 22:52:20 user nova-compute[74507]:   <devices>
Oct 25 22:52:20 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:52:20 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:52:20 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk"/>
Oct 25 22:52:20 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:52:20 user nova-compute[74507]:     </disk>
Oct 25 22:52:20 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:52:20 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:52:20 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 22:52:20 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:52:20 user nova-compute[74507]:       <serial>a547c2ab-ba7b-41ea-9227-6dc4b4861b36</serial>
Oct 25 22:52:20 user nova-compute[74507]:     </disk>
Oct 25 22:52:20 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:52:20 user nova-compute[74507]:       <mac address="fa:16:3e:e7:7b:bc"/>
Oct 25 22:52:20 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:20 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:52:20 user nova-compute[74507]:       <target dev="tap1d8a8c8f-22"/>
Oct 25 22:52:20 user nova-compute[74507]:     </interface>
Oct 25 22:52:20 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:52:20 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/console.log" append="off"/>
Oct 25 22:52:20 user nova-compute[74507]:     </serial>
Oct 25 22:52:20 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:52:20 user nova-compute[74507]:     <video>
Oct 25 22:52:20 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:20 user nova-compute[74507]:     </video>
Oct 25 22:52:20 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:52:20 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:52:20 user nova-compute[74507]:     </rng>
Oct 25 22:52:20 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:52:20 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:52:20 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:52:20 user nova-compute[74507]:     </memballoon>
Oct 25 22:52:20 user nova-compute[74507]:   </devices>
Oct 25 22:52:20 user nova-compute[74507]: </domain>
Oct 25 22:52:20 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-ServerActionsTestOtherA-server-38949155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG os_vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0cdf7fe-24b0-56d8-af48-43665c6ad2e0', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d8a8c8f-22, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d8a8c8f-22, col_values=(('qos', UUID('48e985cd-f391-4414-9bfd-f53645a7f03a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d8a8c8f-22, col_values=(('external_ids', {'iface-id': '1d8a8c8f-2240-4cbe-8a2f-915b0be10d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:7b:bc', 'vm-uuid': '07808568-ed98-469b-a7d7-f5791e93c535'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: INFO os_vif [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22')
Oct 25 22:52:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:52:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:e7:7b:bc, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:21 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f is timed out.
Oct 25 22:52:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdb from instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f from the live domain config.
Oct 25 22:52:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrTNJdOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:52:21 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7926fb28-760a-4870-887b-8bcba4fab1fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:52:21 user nova-compute[74507]: No targets found.
Oct 25 22:52:21 user nova-compute[74507]: iSNS:
Oct 25 22:52:21 user nova-compute[74507]: No targets found.
Oct 25 22:52:21 user nova-compute[74507]: STATIC:
Oct 25 22:52:21 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:52:21 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:52:21 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:52:21 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e
Oct 25 22:52:21 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:52:21 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:52:21 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa
Oct 25 22:52:21 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:52:21 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:52:21 user nova-compute[74507]: FIRMWARE:
Oct 25 22:52:21 user nova-compute[74507]: No targets found.
Oct 25 22:52:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:52:21 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:52:21 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bdff07-d005-4449-9740-2c937bf650a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8c19fd-e4fe-46bc-9f37-5d9ff84b3883]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:21 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:21 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:52:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa (non-flash)
Oct 25 22:52:21 user nova-compute[74507]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:52:21 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:52:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64304790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:52:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64401ebf-06bd-4cc1-95b1-64916c72dd29]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1eb8f8-e9fd-4f98-befc-d376d135cac0]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e0cce3-6c22-40a6-84fd-b1ace8287e9f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ad96b-7b3e-4278-b319-a2f2f5f736ea]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5028ab3-1be6-4fc8-874d-5abdd6136a76]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee262c5f-9599-4049-906f-607dea5d7de4]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260]
Oct 25 22:52:22 user nova-compute[74507]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa, portal: 172.16.0.220,3260] successful.
Oct 25 22:52:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52746134-dd2f-4e6b-9b5f-8262ba49c8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee031ea-c64f-4fec-8c83-5d59cf169bb3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== disconnect_volume: return (375ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:22 user nova-compute[74507]: WARNING nova.compute.manager [req-37ed79d8-9d7e-4e06-abdb-5aba850a6d8f req-eda9a88a-a54d-409d-9c5c-a695a773f80f service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 22:52:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-607c912e-0446-4587-9dec-c0080f49eb34 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.201s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74507) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:24 user nova-compute[74507]: WARNING nova.compute.manager [req-d8311539-86e0-4e68-8b69-304b4a93f516 req-f639f7bb-7697-4351-ba7f-08cc71c07867 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state active and task_state powering-off.
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:24 user nova-compute[74507]: WARNING nova.compute.manager [req-4a0f778b-5930-425c-9975-82b2aa8a82b5 req-b4013dc9-7e79-4b36-8da9-c8b9b973f014 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 22:52:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance destroyed successfully.
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ebad3a1b-ecdb-46ae-b6e3-1e0578d96c85 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.048s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:52:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance spawned successfully.
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74507) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8cebe0f4-a28d-4759-8764-b30021808d44 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.121s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:26 user nova-compute[74507]: WARNING nova.compute.manager [req-26a60aff-5f53-4ce6-84e8-8bfa8baf9bd7 req-90159209-b29b-440e-b50c-2106392dea63 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state None.
Oct 25 22:52:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:52:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:52:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:30 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:52:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7560MB free_disk=25.335357666015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a24bc0e5-a941-49ce-b5f4-36308b71620c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:52:37 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:52:38 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:52:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:52:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:52:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:44 user nova-compute[74507]: INFO nova.compute.manager [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Terminating instance
Oct 25 22:52:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-unplugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] No waiting events found dispatching network-vif-unplugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-28fe25d5-8a5c-4a07-aacc-064de121d16c req-2c987c8a-ef26-4151-b583-a17e2a11638d service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-unplugged-614047c4-9225-41e2-b4d7-148df5858276 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:52:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Instance destroyed successfully.
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lazy-loading 'resources' on Instance uuid a24bc0e5-a941-49ce-b5f4-36308b71620c {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-549955582',display_name='tempest-VolumesAdminNegativeTest-server-549955582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-549955582',id=6,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFdTx2s8ksZ96E2mzqzqpAhjcm9850ytjKfCLSUFgRPjq5sRoCSHKFhVMXSDC9rX3VLQJ03KGv6mIspudN6js09/vI8YIiFATAUyDO790FGhsljhSd/JTWqOMIEp87JAw==',key_name='tempest-keypair-44669929',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efc39403f96043cf828ea29145f20808',ramdisk_id='',reservation_id='r-6rjub2ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-176792302',owner_user_name='tempest-VolumesAdminNegativeTest-176792302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd3304f393f14ab79afd757ea5f32b5f',uuid=a24bc0e5-a941-49ce-b5f4-36308b71620c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converting VIF {"id": "614047c4-9225-41e2-b4d7-148df5858276", "address": "fa:16:3e:48:b1:58", "network": {"id": "a5ba8f94-5126-465b-8960-1ebda6ad746b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1680659230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efc39403f96043cf828ea29145f20808", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap614047c4-92", "ovs_interfaceid": "614047c4-9225-41e2-b4d7-148df5858276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG os_vif [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap614047c4-92, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f1d3049-8b3c-480c-b220-bd1e3e8df708) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: INFO os_vif [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=614047c4-9225-41e2-b4d7-148df5858276,network=Network(a5ba8f94-5126-465b-8960-1ebda6ad746b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614047c4-92')
Oct 25 22:52:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Deleting instance files /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c_del
Oct 25 22:52:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Deletion of /opt/stack/data/nova/instances/a24bc0e5-a941-49ce-b5f4-36308b71620c_del complete
Oct 25 22:52:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:45 user nova-compute[74507]: INFO nova.compute.manager [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 22:52:45 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:52:45 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:52:46 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:52:46 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Took 0.93 seconds to deallocate network for instance.
Oct 25 22:52:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] Acquiring lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] No waiting events found dispatching network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:52:47 user nova-compute[74507]: WARNING nova.compute.manager [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received unexpected event network-vif-plugged-614047c4-9225-41e2-b4d7-148df5858276 for instance with vm_state deleted and task_state None.
Oct 25 22:52:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-c6ad25e5-2ac1-49b1-b5fc-562f168ff20b req-728cef67-d4b8-4cbd-ab9d-5f34caa19977 service nova] [instance: a24bc0e5-a941-49ce-b5f4-36308b71620c] Received event network-vif-deleted-614047c4-9225-41e2-b4d7-148df5858276 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:52:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.699s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:47 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Deleted allocations for instance a24bc0e5-a941-49ce-b5f4-36308b71620c
Oct 25 22:52:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1cd845f3-2530-4421-a58c-f935c4479a2b tempest-VolumesAdminNegativeTest-176792302 tempest-VolumesAdminNegativeTest-176792302-project-member] Lock "a24bc0e5-a941-49ce-b5f4-36308b71620c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.858s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:52:50 user nova-compute[74507]: INFO nova.compute.manager [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] instance snapshotting
Oct 25 22:52:51 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Beginning live snapshot process
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0.delta 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0.delta 1073741824" returned: 0 in 0.049s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:51 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 22:52:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:52:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] COPY block job progress, current cursor: 23789568 final cursor: 75563008 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:52:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:52:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 22:52:53 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:52:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0.delta /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0.delta /opt/stack/data/nova/instances/snapshots/tmp4sc3_8an/c33f44a6300b45c893b9eb844f425bf0" returned: 0 in 0.799s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:54 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Snapshot extracted, beginning image upload
Oct 25 22:52:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:52:56 user nova-compute[74507]: INFO nova.compute.claims [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Claim successful on node user
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:52:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:52:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG nova.policy [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ac1ba6d1a3440f0adeb4484b088355d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abfbc11474245c08187249001cf8854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:52:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Creating image(s)
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "/opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "/opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "/opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk 1073741824" returned: 0 in 0.047s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Successfully created port: 8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:52:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Snapshot image upload complete
Oct 25 22:52:57 user nova-compute[74507]: INFO nova.compute.manager [None req-d446b48f-13c3-4e90-9b1e-ca8f1ed04ef2 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Took 6.79 seconds to snapshot the instance on the hypervisor.
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.234s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:52:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Cannot resize image /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Ensure instance console log exists: /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Successfully updated port: 8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquired lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-changed-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Refreshing instance network info cache due to event network-changed-8218b81a-9297-4c14-b5d0-58537beb970f. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] Acquiring lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.neutron [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updating instance_info_cache with network_info: [{"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Releasing lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Instance network_info: |[{"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] Acquired lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Refreshing network info cache for port 8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Start _get_guest_xml network_info=[{"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:52:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1183618097',display_name='tempest-DeleteServersTestJSON-server-1183618097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1183618097',id=17,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8abfbc11474245c08187249001cf8854',ramdisk_id='',reservation_id='r-l9dvu9vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1065785402',owner_user_name='tempest-DeleteServersTestJSON-1065785402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:52:57Z,user_data=None,user_id='4ac1ba6d1a3440f0adeb4484b088355d',uuid=89c463e4-ba80-4f08-a78c-5cf8754a1772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converting VIF {"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lazy-loading 'pci_devices' on Instance uuid 89c463e4-ba80-4f08-a78c-5cf8754a1772 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:52:58 user nova-compute[74507]:   <uuid>89c463e4-ba80-4f08-a78c-5cf8754a1772</uuid>
Oct 25 22:52:58 user nova-compute[74507]:   <name>instance-00000011</name>
Oct 25 22:52:58 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:52:58 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:52:58 user nova-compute[74507]:   <metadata>
Oct 25 22:52:58 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:52:58 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:name>tempest-DeleteServersTestJSON-server-1183618097</nova:name>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:52:58</nova:creationTime>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:52:58 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:52:58 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:owner>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:user uuid="4ac1ba6d1a3440f0adeb4484b088355d">tempest-DeleteServersTestJSON-1065785402-project-member</nova:user>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:project uuid="8abfbc11474245c08187249001cf8854">tempest-DeleteServersTestJSON-1065785402</nova:project>
Oct 25 22:52:58 user nova-compute[74507]:       </nova:owner>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:52:58 user nova-compute[74507]:       <nova:ports>
Oct 25 22:52:58 user nova-compute[74507]:         <nova:port uuid="8218b81a-9297-4c14-b5d0-58537beb970f">
Oct 25 22:52:58 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 22:52:58 user nova-compute[74507]:         </nova:port>
Oct 25 22:52:58 user nova-compute[74507]:       </nova:ports>
Oct 25 22:52:58 user nova-compute[74507]:     </nova:instance>
Oct 25 22:52:58 user nova-compute[74507]:   </metadata>
Oct 25 22:52:58 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:52:58 user nova-compute[74507]:     <system>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="serial">89c463e4-ba80-4f08-a78c-5cf8754a1772</entry>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="uuid">89c463e4-ba80-4f08-a78c-5cf8754a1772</entry>
Oct 25 22:52:58 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:52:58 user nova-compute[74507]:     </system>
Oct 25 22:52:58 user nova-compute[74507]:   </sysinfo>
Oct 25 22:52:58 user nova-compute[74507]:   <os>
Oct 25 22:52:58 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:52:58 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:52:58 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:52:58 user nova-compute[74507]:   </os>
Oct 25 22:52:58 user nova-compute[74507]:   <features>
Oct 25 22:52:58 user nova-compute[74507]:     <acpi/>
Oct 25 22:52:58 user nova-compute[74507]:     <apic/>
Oct 25 22:52:58 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:52:58 user nova-compute[74507]:   </features>
Oct 25 22:52:58 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:52:58 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:52:58 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:52:58 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:52:58 user nova-compute[74507]:   </clock>
Oct 25 22:52:58 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:52:58 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:52:58 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:52:58 user nova-compute[74507]:   </cpu>
Oct 25 22:52:58 user nova-compute[74507]:   <devices>
Oct 25 22:52:58 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:52:58 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:52:58 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk"/>
Oct 25 22:52:58 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:52:58 user nova-compute[74507]:     </disk>
Oct 25 22:52:58 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:52:58 user nova-compute[74507]:       <mac address="fa:16:3e:81:9b:d3"/>
Oct 25 22:52:58 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:58 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:52:58 user nova-compute[74507]:       <target dev="tap8218b81a-92"/>
Oct 25 22:52:58 user nova-compute[74507]:     </interface>
Oct 25 22:52:58 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:52:58 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/console.log" append="off"/>
Oct 25 22:52:58 user nova-compute[74507]:     </serial>
Oct 25 22:52:58 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:52:58 user nova-compute[74507]:     <video>
Oct 25 22:52:58 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:52:58 user nova-compute[74507]:     </video>
Oct 25 22:52:58 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:52:58 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:52:58 user nova-compute[74507]:     </rng>
Oct 25 22:52:58 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:52:58 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:52:58 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:52:58 user nova-compute[74507]:     </memballoon>
Oct 25 22:52:58 user nova-compute[74507]:   </devices>
Oct 25 22:52:58 user nova-compute[74507]: </domain>
Oct 25 22:52:58 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1183618097',display_name='tempest-DeleteServersTestJSON-server-1183618097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1183618097',id=17,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8abfbc11474245c08187249001cf8854',ramdisk_id='',reservation_id='r-l9dvu9vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1065785402',owner_user_name='tempest-DeleteServersTestJSON-1065785402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:52:57Z,user_data=None,user_id='4ac1ba6d1a3440f0adeb4484b088355d',uuid=89c463e4-ba80-4f08-a78c-5cf8754a1772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converting VIF {"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG os_vif [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '413e89a0-4103-512f-8981-7ad2275c083e', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8218b81a-92, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8218b81a-92, col_values=(('qos', UUID('1e3daa09-1923-4dd6-a1a4-d1f5fe5c6c3b')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8218b81a-92, col_values=(('external_ids', {'iface-id': '8218b81a-9297-4c14-b5d0-58537beb970f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:9b:d3', 'vm-uuid': '89c463e4-ba80-4f08-a78c-5cf8754a1772'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:52:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:52:58 user nova-compute[74507]: INFO os_vif [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92')
Oct 25 22:52:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:52:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] No VIF found with MAC fa:16:3e:81:9b:d3, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:52:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updated VIF entry in instance network info cache for port 8218b81a-9297-4c14-b5d0-58537beb970f. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:52:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updating instance_info_cache with network_info: [{"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:52:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3abf6c60-4e23-4efc-bee5-c331d6b926b8 req-391b9afc-46b1-4294-967d-9fe07eda0afb service nova] Releasing lock "refresh_cache-89c463e4-ba80-4f08-a78c-5cf8754a1772" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:53:00 user nova-compute[74507]: INFO nova.compute.claims [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Claim successful on node user
Oct 25 22:53:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:00 user nova-compute[74507]: WARNING nova.compute.manager [req-5a5b6a90-5887-4855-80ba-c58cb0d60ece req-8a95fbc4-0077-4c8b-b8fe-98fcbdd62058 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received unexpected event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with vm_state building and task_state spawning.
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:53:00 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:53:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.policy [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1673b4507d547f0b1286d8f0a56f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fbc92865504ccf9f8f83c3b530227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:53:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Creating image(s)
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "/opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "/opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "/opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "08a696b82d92840968371cef0caf612bcbea1ddf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "08a696b82d92840968371cef0caf612bcbea1ddf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Successfully created port: 9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG nova.virt.images [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] 096512a4-1099-4229-ae77-83704ce37762 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.part /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:02 user nova-compute[74507]: WARNING nova.compute.manager [req-ad474c0d-2128-48d2-9990-0dc03cb0518d req-a46fc18e-260b-41df-bf0e-c0ff7cfc8fd6 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received unexpected event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with vm_state building and task_state spawning.
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.part /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.converted" returned: 0 in 0.567s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "08a696b82d92840968371cef0caf612bcbea1ddf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.253s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Successfully updated port: 9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:53:03 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Instance spawned successfully.
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquired lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing instance network info cache due to event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] Acquiring lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json" returned: 0 in 0.242s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "08a696b82d92840968371cef0caf612bcbea1ddf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "08a696b82d92840968371cef0caf612bcbea1ddf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:03 user nova-compute[74507]: INFO nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Took 6.88 seconds to spawn the instance on the hypervisor.
Oct 25 22:53:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:53:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: INFO nova.compute.manager [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Took 7.81 seconds to build instance.
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf,backing_fmt=raw /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-69ef36cb-2e7f-4571-8ae0-f1f1dc85e94b tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.976s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf,backing_fmt=raw /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk 1073741824" returned: 0 in 0.056s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "08a696b82d92840968371cef0caf612bcbea1ddf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating instance_info_cache with network_info: [{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Releasing lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Instance network_info: |[{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] Acquired lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf --force-share --output=json" returned: 0 in 0.209s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Ensure instance console log exists: /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Start _get_guest_xml network_info=[{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b4246cc8e3991e94af446c08b6ad51fb',container_format='bare',created_at=2023-10-25T22:52:51Z,direct_url=<?>,disk_format='qcow2',id=096512a4-1099-4229-ae77-83704ce37762,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-144310233',owner='d8fbc92865504ccf9f8f83c3b530227d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T22:52:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '096512a4-1099-4229-ae77-83704ce37762'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:53:04 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:04 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b4246cc8e3991e94af446c08b6ad51fb',container_format='bare',created_at=2023-10-25T22:52:51Z,direct_url=<?>,disk_format='qcow2',id=096512a4-1099-4229-ae77-83704ce37762,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-144310233',owner='d8fbc92865504ccf9f8f83c3b530227d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T22:52:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-974110021',display_name='tempest-TestStampPattern-server-974110021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-974110021',id=18,image_ref='096512a4-1099-4229-ae77-83704ce37762',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-vqu0j70h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='734cab0d-b6c6-4a43-95fa-cdd885639464',image_min_disk='1',image_min_ram='0',image_owner_id='d8fbc92865504ccf9f8f83c3b530227d',image_owner_project_name='tempest-TestStampPattern-899029107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-899029107-project-member',image_user_id='a1673b4507d547f0b1286d8f0a56f3b3',network_allocated='True',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:01Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=2db4ebfb-3ff8-442e-b971-0a3d37861715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'pci_devices' on Instance uuid 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:53:04 user nova-compute[74507]:   <uuid>2db4ebfb-3ff8-442e-b971-0a3d37861715</uuid>
Oct 25 22:53:04 user nova-compute[74507]:   <name>instance-00000012</name>
Oct 25 22:53:04 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:53:04 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:53:04 user nova-compute[74507]:   <metadata>
Oct 25 22:53:04 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:53:04 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:name>tempest-TestStampPattern-server-974110021</nova:name>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:53:04</nova:creationTime>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:53:04 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:53:04 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:owner>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:user uuid="a1673b4507d547f0b1286d8f0a56f3b3">tempest-TestStampPattern-899029107-project-member</nova:user>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:project uuid="d8fbc92865504ccf9f8f83c3b530227d">tempest-TestStampPattern-899029107</nova:project>
Oct 25 22:53:04 user nova-compute[74507]:       </nova:owner>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:root type="image" uuid="096512a4-1099-4229-ae77-83704ce37762"/>
Oct 25 22:53:04 user nova-compute[74507]:       <nova:ports>
Oct 25 22:53:04 user nova-compute[74507]:         <nova:port uuid="9880ed69-8425-49aa-889d-ff0ad49562b3">
Oct 25 22:53:04 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 22:53:04 user nova-compute[74507]:         </nova:port>
Oct 25 22:53:04 user nova-compute[74507]:       </nova:ports>
Oct 25 22:53:04 user nova-compute[74507]:     </nova:instance>
Oct 25 22:53:04 user nova-compute[74507]:   </metadata>
Oct 25 22:53:04 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:53:04 user nova-compute[74507]:     <system>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="serial">2db4ebfb-3ff8-442e-b971-0a3d37861715</entry>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="uuid">2db4ebfb-3ff8-442e-b971-0a3d37861715</entry>
Oct 25 22:53:04 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:53:04 user nova-compute[74507]:     </system>
Oct 25 22:53:04 user nova-compute[74507]:   </sysinfo>
Oct 25 22:53:04 user nova-compute[74507]:   <os>
Oct 25 22:53:04 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:53:04 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:53:04 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:53:04 user nova-compute[74507]:   </os>
Oct 25 22:53:04 user nova-compute[74507]:   <features>
Oct 25 22:53:04 user nova-compute[74507]:     <acpi/>
Oct 25 22:53:04 user nova-compute[74507]:     <apic/>
Oct 25 22:53:04 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:53:04 user nova-compute[74507]:   </features>
Oct 25 22:53:04 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:53:04 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:53:04 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:53:04 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:53:04 user nova-compute[74507]:   </clock>
Oct 25 22:53:04 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:53:04 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:53:04 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:53:04 user nova-compute[74507]:   </cpu>
Oct 25 22:53:04 user nova-compute[74507]:   <devices>
Oct 25 22:53:04 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:53:04 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:53:04 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk"/>
Oct 25 22:53:04 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:53:04 user nova-compute[74507]:     </disk>
Oct 25 22:53:04 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:53:04 user nova-compute[74507]:       <mac address="fa:16:3e:10:a7:c4"/>
Oct 25 22:53:04 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:53:04 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:53:04 user nova-compute[74507]:       <target dev="tap9880ed69-84"/>
Oct 25 22:53:04 user nova-compute[74507]:     </interface>
Oct 25 22:53:04 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:53:04 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/console.log" append="off"/>
Oct 25 22:53:04 user nova-compute[74507]:     </serial>
Oct 25 22:53:04 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:53:04 user nova-compute[74507]:     <video>
Oct 25 22:53:04 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:53:04 user nova-compute[74507]:     </video>
Oct 25 22:53:04 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:53:04 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:53:04 user nova-compute[74507]:     </rng>
Oct 25 22:53:04 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:53:04 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:53:04 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:53:04 user nova-compute[74507]:     </memballoon>
Oct 25 22:53:04 user nova-compute[74507]:   </devices>
Oct 25 22:53:04 user nova-compute[74507]: </domain>
Oct 25 22:53:04 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-974110021',display_name='tempest-TestStampPattern-server-974110021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-974110021',id=18,image_ref='096512a4-1099-4229-ae77-83704ce37762',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-vqu0j70h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='734cab0d-b6c6-4a43-95fa-cdd885639464',image_min_disk='1',image_min_ram='0',image_owner_id='d8fbc92865504ccf9f8f83c3b530227d',image_owner_project_name='tempest-TestStampPattern-899029107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-899029107-project-member',image_user_id='a1673b4507d547f0b1286d8f0a56f3b3',network_allocated='True',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:01Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=2db4ebfb-3ff8-442e-b971-0a3d37861715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG os_vif [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a768010-edec-5c43-83ab-0c83acf2181c', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9880ed69-84, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9880ed69-84, col_values=(('qos', UUID('c7fdb0d1-bb8d-4077-908a-e48655811bed')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9880ed69-84, col_values=(('external_ids', {'iface-id': '9880ed69-8425-49aa-889d-ff0ad49562b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:a7:c4', 'vm-uuid': '2db4ebfb-3ff8-442e-b971-0a3d37861715'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:04 user nova-compute[74507]: INFO os_vif [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84')
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No VIF found with MAC fa:16:3e:10:a7:c4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updated VIF entry in instance network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating instance_info_cache with network_info: [{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e2e9692-0687-40e7-8d11-b7a78e2a58ba req-9e0fd605-674d-4b0d-843b-790463f29007 service nova] Releasing lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] No waiting events found dispatching network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:06 user nova-compute[74507]: WARNING nova.compute.manager [req-d5dba52f-a93d-4f0a-9f59-5f7e57b1df5e req-a7f4338b-e4c8-4bdd-aa7b-89c8386dddc7 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received unexpected event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 for instance with vm_state building and task_state spawning.
Oct 25 22:53:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] No waiting events found dispatching network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:08 user nova-compute[74507]: WARNING nova.compute.manager [req-567f4892-65c3-44b5-b3f2-49095b43c8b6 req-fc27a011-c297-46b0-b12d-aa31623ddecf service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received unexpected event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 for instance with vm_state building and task_state spawning.
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:53:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Instance spawned successfully.
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:53:09 user nova-compute[74507]: INFO nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Took 7.83 seconds to spawn the instance on the hypervisor.
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:53:09 user nova-compute[74507]: INFO nova.compute.manager [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Took 9.01 seconds to build instance.
Oct 25 22:53:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7332dc01-383c-42f1-8b46-a48ae29b1f63 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.155s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-changed-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Refreshing instance network info cache due to event network-changed-fe9f8da9-003e-4568-accb-67509146fef1. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] Acquiring lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] Acquired lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG nova.network.neutron [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Refreshing network info cache for port fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updated VIF entry in instance network info cache for port fe9f8da9-003e-4568-accb-67509146fef1. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:53:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d4badb3f-4e4d-4da3-80f9-6b035ad74841 req-c4b9f87b-0c6c-48a7-98bd-36d6d3890a62 service nova] Releasing lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:53:11 user nova-compute[74507]: INFO nova.compute.manager [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] instance snapshotting
Oct 25 22:53:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Beginning live snapshot process
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json -f qcow2" returned: 0 in 0.251s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151.delta 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151.delta 1073741824" returned: 0 in 0.070s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:12 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 22:53:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:53:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:53:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 22:53:13 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:53:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151.delta /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151.delta /opt/stack/data/nova/instances/snapshots/tmpbdstle6j/021c6a487a4e42fd84a8a9dbd38d8151" returned: 0 in 0.549s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:14 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Snapshot extracted, beginning image upload
Oct 25 22:53:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Snapshot image upload complete
Oct 25 22:53:17 user nova-compute[74507]: INFO nova.compute.manager [None req-9bacfcdf-2364-4fc5-8dcc-5bbf083a9ca0 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Took 5.97 seconds to snapshot the instance on the hypervisor.
Oct 25 22:53:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:19 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:53:19 user nova-compute[74507]: INFO nova.compute.claims [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Claim successful on node user
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:53:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:53:20 user nova-compute[74507]: INFO nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Booting with volume 974f7054-1cbb-4488-9188-c43aa6684c48 at /dev/vda
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.policy [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b0110d43df444a5952a733c8e365773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef290b352cc6495a86059ef9d86fa0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c098dd1-facd-4f4d-bee5-6252648b41bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52f821-5f61-4a94-98de-e97d3d7e20d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[75415f7e-3819-44b9-ba7a-3bf46823b6f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0472b-1be3-4d93-9408-20aefb7cdea4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:20 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:53:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3095b-399f-4d7a-9cec-b0accc472d8e]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating existing volume attachment record: aad0b8af-91bb-4eab-a5bd-dc1f31a50e9b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:53:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully created port: 3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully created port: dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:22 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully created port: 0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:23 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully created port: acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully created port: 96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: 3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-3b853a11-eadd-472c-b5f3-79762da19260. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port 3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9337462c-85b7-4d94-bd7f-cc46396b1b64 req-2287d6c8-53b2-42db-b4e8-371a88934ea8 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-e557d1e1-6eaa-42ec-af97-a2bb6fca1475. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dd022c9b-6b8c-4d74-bbdd-654cfba06b66 req-16c6c81b-b8d9-44f0-a440-be07949c9d33 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: 0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:53:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-dbf87b02-650f-4609-ae6b-bcef8a2eaa00. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-0522c4c9-c604-4fca-859d-1eba394d7c5a. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port 0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Successfully updated port: 96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f3910f8b-338c-4d84-b418-bb387eeba1b2 req-5446ab61-3956-48a9-9b73-74d0344f4411 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-96d095b5-56cc-4d88-9e93-79cec1e314bc. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:53:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance network_info: |[{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port 96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updated VIF entry in instance network info cache for port 96d095b5-56cc-4d88-9e93-79cec1e314bc. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d1198f8e-80ca-45b1-95e8-2d9d044ee34e req-52f38e33-2154-40fc-8135-65cc29b33ac2 service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:53:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=25.083209991455078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 89c463e4-ba80-4f08-a78c-5cf8754a1772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 6ad95b09-8a62-446b-b5cf-b42ff1093b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:53:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:53:38 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:53:38 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:53:38 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:53:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:40 user nova-compute[74507]: INFO nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Booting with volume 113323cd-644a-4c9d-a441-817af37372f2 at /dev/vdb
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48385397-4902-446e-8d3f-77864110f568]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e197ca79-4936-409a-8bb9-90f56214eefc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635c07b-1439-4da4-b8a4-807ccec5fc7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8bf6fa-6b63-4030-8491-75d58e716089]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:40 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:53:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8eec77-d6a7-488b-91be-8e43c2425d6a]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating existing volume attachment record: 012bcb70-b570-41df-bdfa-d5a8a9c2a5cc {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:53:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:46 user nova-compute[74507]: INFO nova.compute.manager [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Terminating instance
Oct 25 22:53:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-unplugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] No waiting events found dispatching network-vif-unplugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-ce27a6dd-fcfb-4e4b-9b12-1f0e84966ce4 req-556965ab-c31e-49a6-b4c3-7a960da04c25 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-unplugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:53:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Instance destroyed successfully.
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.objects.instance [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lazy-loading 'resources' on Instance uuid 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-233653405',display_name='tempest-VolumesActionsTest-instance-233653405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-233653405',id=16,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:51:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae1852140ec949278f908d4282813506',ramdisk_id='',reservation_id='r-rq7b1y9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-18069715',owner_user_name='tempest-VolumesActionsTest-18069715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:51:46Z,user_data=None,user_id='218e1fab1ba746fb8f1f1d3aac76a64f',uuid=86c0d195-f282-4e93-8ebb-16f1ec73c8f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converting VIF {"id": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "address": "fa:16:3e:6b:19:f9", "network": {"id": "cc2ad736-fe55-4dd7-b855-72744d9edea5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1010880443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1852140ec949278f908d4282813506", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bbbfb3-ca", "ovs_interfaceid": "50bbbfb3-ca42-4080-b184-9813aaf43c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG os_vif [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50bbbfb3-ca, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4edc124a-bc40-4444-938c-8907b0646310) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:47 user nova-compute[74507]: INFO os_vif [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:19:f9,bridge_name='br-int',has_traffic_filtering=True,id=50bbbfb3-ca42-4080-b184-9813aaf43c5d,network=Network(cc2ad736-fe55-4dd7-b855-72744d9edea5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bbbfb3-ca')
Oct 25 22:53:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Deleting instance files /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6_del
Oct 25 22:53:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Deletion of /opt/stack/data/nova/instances/86c0d195-f282-4e93-8ebb-16f1ec73c8f6_del complete
Oct 25 22:53:47 user nova-compute[74507]: INFO nova.compute.manager [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 25 22:53:47 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:53:47 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:47 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Took 0.68 seconds to deallocate network for instance.
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-09b71dce-bc67-4980-a8b8-99db21f899ed req-139e7277-7867-456c-9958-52796e5f7e51 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-deleted-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:48 user nova-compute[74507]: INFO nova.compute.manager [req-09b71dce-bc67-4980-a8b8-99db21f899ed req-139e7277-7867-456c-9958-52796e5f7e51 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Neutron deleted interface 50bbbfb3-ca42-4080-b184-9813aaf43c5d; detaching it from the instance and deleting it from the info cache
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.network.neutron [req-09b71dce-bc67-4980-a8b8-99db21f899ed req-139e7277-7867-456c-9958-52796e5f7e51 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-09b71dce-bc67-4980-a8b8-99db21f899ed req-139e7277-7867-456c-9958-52796e5f7e51 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Detach interface failed, port_id=50bbbfb3-ca42-4080-b184-9813aaf43c5d, reason: Instance 86c0d195-f282-4e93-8ebb-16f1ec73c8f6 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:48 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Deleted allocations for instance 86c0d195-f282-4e93-8ebb-16f1ec73c8f6
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-402d6ffb-612c-4eef-bc59-483a2b0ea9e7 tempest-VolumesActionsTest-18069715 tempest-VolumesActionsTest-18069715-project-member] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] Acquiring lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] Lock "86c0d195-f282-4e93-8ebb-16f1ec73c8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] No waiting events found dispatching network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:48 user nova-compute[74507]: WARNING nova.compute.manager [req-568699af-a410-4e16-b297-07c0a1ac9843 req-a76b5a37-fcfa-49e2-9219-311807bab727 service nova] [instance: 86c0d195-f282-4e93-8ebb-16f1ec73c8f6] Received unexpected event network-vif-plugged-50bbbfb3-ca42-4080-b184-9813aaf43c5d for instance with vm_state deleted and task_state None.
Oct 25 22:53:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:53:54 user nova-compute[74507]: INFO nova.compute.claims [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Claim successful on node user
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:53:54 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.policy [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4da245cae18d400ab7b8c787bfd10156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdf2550d504422686b0a2a829758690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:53:54 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Creating image(s)
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "/opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk 1073741824" returned: 0 in 0.057s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Successfully created port: d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Cannot resize image /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Ensure instance console log exists: /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Successfully updated port: d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-changed-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Refreshing instance network info cache due to event network-changed-d10563e3-876d-4666-bed8-aefcf7f293c4. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:53:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] Acquiring lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Instance network_info: |[{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] Acquired lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.neutron [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Refreshing network info cache for port d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Start _get_guest_xml network_info=[{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:53:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157347298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157347298',id=20,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-qxqyp7dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:55Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=50c79d76-a840-4ae4-9425-03993a3c3e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:53:56 user nova-compute[74507]:   <uuid>50c79d76-a840-4ae4-9425-03993a3c3e5e</uuid>
Oct 25 22:53:56 user nova-compute[74507]:   <name>instance-00000014</name>
Oct 25 22:53:56 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:53:56 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:53:56 user nova-compute[74507]:   <metadata>
Oct 25 22:53:56 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:53:56 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-157347298</nova:name>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:53:56</nova:creationTime>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:53:56 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:53:56 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:owner>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 22:53:56 user nova-compute[74507]:       </nova:owner>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:53:56 user nova-compute[74507]:       <nova:ports>
Oct 25 22:53:56 user nova-compute[74507]:         <nova:port uuid="d10563e3-876d-4666-bed8-aefcf7f293c4">
Oct 25 22:53:56 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:53:56 user nova-compute[74507]:         </nova:port>
Oct 25 22:53:56 user nova-compute[74507]:       </nova:ports>
Oct 25 22:53:56 user nova-compute[74507]:     </nova:instance>
Oct 25 22:53:56 user nova-compute[74507]:   </metadata>
Oct 25 22:53:56 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:53:56 user nova-compute[74507]:     <system>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="serial">50c79d76-a840-4ae4-9425-03993a3c3e5e</entry>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="uuid">50c79d76-a840-4ae4-9425-03993a3c3e5e</entry>
Oct 25 22:53:56 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:53:56 user nova-compute[74507]:     </system>
Oct 25 22:53:56 user nova-compute[74507]:   </sysinfo>
Oct 25 22:53:56 user nova-compute[74507]:   <os>
Oct 25 22:53:56 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:53:56 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:53:56 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:53:56 user nova-compute[74507]:   </os>
Oct 25 22:53:56 user nova-compute[74507]:   <features>
Oct 25 22:53:56 user nova-compute[74507]:     <acpi/>
Oct 25 22:53:56 user nova-compute[74507]:     <apic/>
Oct 25 22:53:56 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:53:56 user nova-compute[74507]:   </features>
Oct 25 22:53:56 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:53:56 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:53:56 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:53:56 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:53:56 user nova-compute[74507]:   </clock>
Oct 25 22:53:56 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:53:56 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:53:56 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:53:56 user nova-compute[74507]:   </cpu>
Oct 25 22:53:56 user nova-compute[74507]:   <devices>
Oct 25 22:53:56 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:53:56 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:53:56 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk"/>
Oct 25 22:53:56 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:53:56 user nova-compute[74507]:     </disk>
Oct 25 22:53:56 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:53:56 user nova-compute[74507]:       <mac address="fa:16:3e:23:19:cb"/>
Oct 25 22:53:56 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:53:56 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:53:56 user nova-compute[74507]:       <target dev="tapd10563e3-87"/>
Oct 25 22:53:56 user nova-compute[74507]:     </interface>
Oct 25 22:53:56 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:53:56 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/console.log" append="off"/>
Oct 25 22:53:56 user nova-compute[74507]:     </serial>
Oct 25 22:53:56 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:53:56 user nova-compute[74507]:     <video>
Oct 25 22:53:56 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:53:56 user nova-compute[74507]:     </video>
Oct 25 22:53:56 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:53:56 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:53:56 user nova-compute[74507]:     </rng>
Oct 25 22:53:56 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:53:56 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:53:56 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:53:56 user nova-compute[74507]:     </memballoon>
Oct 25 22:53:56 user nova-compute[74507]:   </devices>
Oct 25 22:53:56 user nova-compute[74507]: </domain>
Oct 25 22:53:56 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157347298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157347298',id=20,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-qxqyp7dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:55Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=50c79d76-a840-4ae4-9425-03993a3c3e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG os_vif [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21906d3e-88ee-5c90-9e61-ac76c8e359b2', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd10563e3-87, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd10563e3-87, col_values=(('qos', UUID('acee2978-412c-4bf4-9631-962b505a61de')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd10563e3-87, col_values=(('external_ids', {'iface-id': 'd10563e3-876d-4666-bed8-aefcf7f293c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:19:cb', 'vm-uuid': '50c79d76-a840-4ae4-9425-03993a3c3e5e'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:56 user nova-compute[74507]: INFO os_vif [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87')
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:23:19:cb, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.neutron [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updated VIF entry in instance network info cache for port d10563e3-876d-4666-bed8-aefcf7f293c4. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG nova.network.neutron [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:53:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1355c14e-408c-4967-b8a2-1bf57e16eb28 req-0d72123c-c4f2-4d6c-8e59-0fb992df22f7 service nova] Releasing lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:53:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] No waiting events found dispatching network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:53:58 user nova-compute[74507]: WARNING nova.compute.manager [req-d24c0158-94a4-4933-8dd4-a9184b42cf5d req-7b3305df-8f86-45ab-ad47-a31efd912976 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received unexpected event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 for instance with vm_state building and task_state spawning.
Oct 25 22:53:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:53:59 user nova-compute[74507]: INFO nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Booting with volume e4183cd1-bac0-44da-b5bf-50590f0aa376 at /dev/vdc
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf05d7e-adc5-4550-87bc-7e94480a025c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed1af56-3601-4d14-ab48-94a299e1240a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6832181-164f-44f3-94ab-79cf1ae47d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d206c5c7-8cb6-48da-b07a-29116cff773c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:53:59 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:53:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bdce65-40e4-4267-8974-38b785e1f5f4]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:53:59 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating existing volume attachment record: 1ebb9fad-e6b0-4ea0-b80d-4e96b104fb85 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] No waiting events found dispatching network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:00 user nova-compute[74507]: WARNING nova.compute.manager [req-cfaee5b2-d963-446f-a1ed-135bc290d61f req-8d661475-1653-43f0-80a0-f1f043665455 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received unexpected event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 for instance with vm_state building and task_state spawning.
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:54:00 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Instance spawned successfully.
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:00 user nova-compute[74507]: INFO nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 25 22:54:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:54:00 user nova-compute[74507]: INFO nova.compute.manager [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Took 6.28 seconds to build instance.
Oct 25 22:54:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e18738e-6311-4f18-8b78-2185dd37ccf1 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.389s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:54:07 user nova-compute[74507]: INFO nova.compute.claims [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Claim successful on node user
Oct 25 22:54:07 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:54:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.policy [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4427778755994cca9d47b515e4aed8ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70aab19396a0456fbe1e2dc9a8829bcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:54:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Creating image(s)
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk 1073741824" returned: 0 in 0.048s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:54:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Successfully created port: cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Cannot resize image /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Ensure instance console log exists: /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Successfully updated port: cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing instance network info cache due to event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:54:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance network_info: |[{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start _get_guest_xml network_info=[{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:54:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1958550715',display_name='tempest-ServerRescueNegativeTestJSON-server-1958550715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1958550715',id=21,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIY85996ZqLbqvshNzZSsujgnp/ztI7GN/hGUjYO3U8dGZLWF3nCBiUPa3CVpbxDKtdqHED8YGvMJvNmTJjKFztx7lAeaOksc5O+gpQy8hYynSJ3Yr6OFji5b7rKkM//A==',key_name='tempest-keypair-855081839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-xwfxqu5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4427778755994cca9d47b515e4aed8ea',uuid=2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:54:10 user nova-compute[74507]:   <uuid>2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</uuid>
Oct 25 22:54:10 user nova-compute[74507]:   <name>instance-00000015</name>
Oct 25 22:54:10 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:54:10 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:54:10 user nova-compute[74507]:   <metadata>
Oct 25 22:54:10 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:54:10 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1958550715</nova:name>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:54:10</nova:creationTime>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:54:10 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:54:10 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:owner>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:54:10 user nova-compute[74507]:       </nova:owner>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:54:10 user nova-compute[74507]:       <nova:ports>
Oct 25 22:54:10 user nova-compute[74507]:         <nova:port uuid="cf6f3743-2f78-43f1-871c-e88929de8281">
Oct 25 22:54:10 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 22:54:10 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:10 user nova-compute[74507]:       </nova:ports>
Oct 25 22:54:10 user nova-compute[74507]:     </nova:instance>
Oct 25 22:54:10 user nova-compute[74507]:   </metadata>
Oct 25 22:54:10 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:54:10 user nova-compute[74507]:     <system>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="serial">2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</entry>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="uuid">2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</entry>
Oct 25 22:54:10 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:54:10 user nova-compute[74507]:     </system>
Oct 25 22:54:10 user nova-compute[74507]:   </sysinfo>
Oct 25 22:54:10 user nova-compute[74507]:   <os>
Oct 25 22:54:10 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:54:10 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:54:10 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:54:10 user nova-compute[74507]:   </os>
Oct 25 22:54:10 user nova-compute[74507]:   <features>
Oct 25 22:54:10 user nova-compute[74507]:     <acpi/>
Oct 25 22:54:10 user nova-compute[74507]:     <apic/>
Oct 25 22:54:10 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:54:10 user nova-compute[74507]:   </features>
Oct 25 22:54:10 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:54:10 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:54:10 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:54:10 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:54:10 user nova-compute[74507]:   </clock>
Oct 25 22:54:10 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:54:10 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:54:10 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:54:10 user nova-compute[74507]:   </cpu>
Oct 25 22:54:10 user nova-compute[74507]:   <devices>
Oct 25 22:54:10 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:54:10 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:54:10 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk"/>
Oct 25 22:54:10 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:54:10 user nova-compute[74507]:     </disk>
Oct 25 22:54:10 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:10 user nova-compute[74507]:       <mac address="fa:16:3e:d8:5f:c8"/>
Oct 25 22:54:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:10 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:10 user nova-compute[74507]:       <target dev="tapcf6f3743-2f"/>
Oct 25 22:54:10 user nova-compute[74507]:     </interface>
Oct 25 22:54:10 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:54:10 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/console.log" append="off"/>
Oct 25 22:54:10 user nova-compute[74507]:     </serial>
Oct 25 22:54:10 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:54:10 user nova-compute[74507]:     <video>
Oct 25 22:54:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:10 user nova-compute[74507]:     </video>
Oct 25 22:54:10 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:54:10 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:54:10 user nova-compute[74507]:     </rng>
Oct 25 22:54:10 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:54:10 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:54:10 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:54:10 user nova-compute[74507]:     </memballoon>
Oct 25 22:54:10 user nova-compute[74507]:   </devices>
Oct 25 22:54:10 user nova-compute[74507]: </domain>
Oct 25 22:54:10 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1958550715',display_name='tempest-ServerRescueNegativeTestJSON-server-1958550715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1958550715',id=21,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIY85996ZqLbqvshNzZSsujgnp/ztI7GN/hGUjYO3U8dGZLWF3nCBiUPa3CVpbxDKtdqHED8YGvMJvNmTJjKFztx7lAeaOksc5O+gpQy8hYynSJ3Yr6OFji5b7rKkM//A==',key_name='tempest-keypair-855081839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-xwfxqu5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4427778755994cca9d47b515e4aed8ea',uuid=2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG os_vif [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f59a5caf-ad90-531e-a237-b06cdf8f841f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf6f3743-2f, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf6f3743-2f, col_values=(('qos', UUID('740efadc-14c9-45f0-af7f-059421b36f4a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf6f3743-2f, col_values=(('external_ids', {'iface-id': 'cf6f3743-2f78-43f1-871c-e88929de8281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:5f:c8', 'vm-uuid': '2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:10 user nova-compute[74507]: INFO os_vif [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f')
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:d8:5f:c8, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updated VIF entry in instance network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-238d7577-5660-4244-b276-dc5343e7e599 req-022e4858-152d-4f43-a001-b81d8e8da5ae service nova] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:54:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:12 user nova-compute[74507]: WARNING nova.compute.manager [req-3fe0557c-8f3f-4a3a-91a4-49ec808a0abf req-368f9cdb-c4fa-40ff-8a45-749c69cf0d53 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state building and task_state spawning.
Oct 25 22:54:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:14 user nova-compute[74507]: WARNING nova.compute.manager [req-ef41c251-f3ff-42d7-a3f0-44f94f4c85bd req-9b0f10d6-9ef2-4e38-8f6f-9d4bf7cb41fd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state building and task_state spawning.
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:54:14 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance spawned successfully.
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:14 user nova-compute[74507]: INFO nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 25 22:54:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:54:14 user nova-compute[74507]: INFO nova.compute.manager [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Took 6.81 seconds to build instance.
Oct 25 22:54:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690f7113-033c-45aa-b6ae-236cb81a9a4c tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquired lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'info_cache' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Releasing lock "refresh_cache-85d61c17-cfbd-4e09-8bea-04b71f28b94f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:54:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance destroyed successfully.
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'resources' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG os_vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e79bc5-63, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac7d470c-209e-49a2-847d-06395f6cacec) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:15 user nova-compute[74507]: INFO os_vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start _get_guest_xml network_info=[{"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'numa_topology' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'pci_devices' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:54:15 user nova-compute[74507]:   <uuid>85d61c17-cfbd-4e09-8bea-04b71f28b94f</uuid>
Oct 25 22:54:15 user nova-compute[74507]:   <name>instance-00000005</name>
Oct 25 22:54:15 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:54:15 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:54:15 user nova-compute[74507]:   <metadata>
Oct 25 22:54:15 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:54:15 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeTestJSON-server-962271633</nova:name>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:54:15</nova:creationTime>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:54:15 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:54:15 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:owner>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:user uuid="62ab99f645064dacb32c07b5beae3f8f">tempest-AttachVolumeTestJSON-1587183484-project-member</nova:user>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:project uuid="0a9cb2b4089144f4b19cd0a3cba46a8e">tempest-AttachVolumeTestJSON-1587183484</nova:project>
Oct 25 22:54:15 user nova-compute[74507]:       </nova:owner>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:54:15 user nova-compute[74507]:       <nova:ports>
Oct 25 22:54:15 user nova-compute[74507]:         <nova:port uuid="76e79bc5-6314-4fde-bb5e-9541d1a48274">
Oct 25 22:54:15 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 22:54:15 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:15 user nova-compute[74507]:       </nova:ports>
Oct 25 22:54:15 user nova-compute[74507]:     </nova:instance>
Oct 25 22:54:15 user nova-compute[74507]:   </metadata>
Oct 25 22:54:15 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:54:15 user nova-compute[74507]:     <system>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="serial">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="uuid">85d61c17-cfbd-4e09-8bea-04b71f28b94f</entry>
Oct 25 22:54:15 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:54:15 user nova-compute[74507]:     </system>
Oct 25 22:54:15 user nova-compute[74507]:   </sysinfo>
Oct 25 22:54:15 user nova-compute[74507]:   <os>
Oct 25 22:54:15 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:54:15 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:54:15 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:54:15 user nova-compute[74507]:   </os>
Oct 25 22:54:15 user nova-compute[74507]:   <features>
Oct 25 22:54:15 user nova-compute[74507]:     <acpi/>
Oct 25 22:54:15 user nova-compute[74507]:     <apic/>
Oct 25 22:54:15 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:54:15 user nova-compute[74507]:   </features>
Oct 25 22:54:15 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:54:15 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:54:15 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:54:15 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:54:15 user nova-compute[74507]:   </clock>
Oct 25 22:54:15 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:54:15 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:54:15 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:54:15 user nova-compute[74507]:   </cpu>
Oct 25 22:54:15 user nova-compute[74507]:   <devices>
Oct 25 22:54:15 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:54:15 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:54:15 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk"/>
Oct 25 22:54:15 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:54:15 user nova-compute[74507]:     </disk>
Oct 25 22:54:15 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:15 user nova-compute[74507]:       <mac address="fa:16:3e:e7:ff:6d"/>
Oct 25 22:54:15 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:15 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:15 user nova-compute[74507]:       <target dev="tap76e79bc5-63"/>
Oct 25 22:54:15 user nova-compute[74507]:     </interface>
Oct 25 22:54:15 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:54:15 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/console.log" append="off"/>
Oct 25 22:54:15 user nova-compute[74507]:     </serial>
Oct 25 22:54:15 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:54:15 user nova-compute[74507]:     <video>
Oct 25 22:54:15 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:15 user nova-compute[74507]:     </video>
Oct 25 22:54:15 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:54:15 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:54:15 user nova-compute[74507]:     </rng>
Oct 25 22:54:15 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:54:15 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:54:15 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:54:15 user nova-compute[74507]:     </memballoon>
Oct 25 22:54:15 user nova-compute[74507]:   </devices>
Oct 25 22:54:15 user nova-compute[74507]: </domain>
Oct 25 22:54:15 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:54:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Cannot resize image /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'migration_context' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.objects.base [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Object Instance<85d61c17-cfbd-4e09-8bea-04b71f28b94f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG os_vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0979985-7805-57b4-9360-02c8ad84496a', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76e79bc5-63, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76e79bc5-63, col_values=(('qos', UUID('b12950f7-a2f0-45dd-a846-ddffeb175b11')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76e79bc5-63, col_values=(('external_ids', {'iface-id': '76e79bc5-6314-4fde-bb5e-9541d1a48274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ff:6d', 'vm-uuid': '85d61c17-cfbd-4e09-8bea-04b71f28b94f'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:16 user nova-compute[74507]: INFO os_vif [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:54:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:18 user nova-compute[74507]: WARNING nova.compute.manager [req-5a8ccef8-3ab2-482e-89da-1d1d041ff025 req-f45dc32e-5cf0-42a0-9196-158a61badb01 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state powering-on.
Oct 25 22:54:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:20 user nova-compute[74507]: WARNING nova.compute.manager [req-6315ae4e-5f15-4786-8ac7-7c8c64994817 req-9493a42e-f949-4849-a67f-c3a7890dbdc0 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state stopped and task_state powering-on.
Oct 25 22:54:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:54:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance rebooted successfully.
Oct 25 22:54:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8a0c9a41-5dbf-4480-acf5-35edfc2bafcc tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:54:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:54:27 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Creating image(s)
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Ensure instance console log exists: /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Start _get_guest_xml network_info=[{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aad0b8af-91bb-4eab-a5bd-dc1f31a50e9b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlayxuoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ad95b09-8a62-446b-b5cf-b42ff1093b41', 'attached_at': '', 'detached_at': '', 'volume_id': '974f7054-1cbb-4488-9188-c43aa6684c48', 'serial': '974f7054-1cbb-4488-9188-c43aa6684c48'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '012bcb70-b570-41df-bdfa-d5a8a9c2a5cc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxLJFntg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ad95b09-8a62-446b-b5cf-b42ff1093b41', 'attached_at': '', 'detached_at': '', 'volume_id': '113323cd-644a-4c9d-a441-817af37372f2', 'serial': '113323cd-644a-4c9d-a441-817af37372f2'}, 'boot_index': 1, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '1ebb9fad-e6b0-4ea0-b80d-4e96b104fb85', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmdDGXgM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ad95b09-8a62-446b-b5cf-b42ff1093b41', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4183cd1-bac0-44da-b5bf-50590f0aa376', 'serial': 'e4183cd1-bac0-44da-b5bf-50590f0aa376'}, 'boot_index': 2, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:54:27 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:27 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlayxuoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:27 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:27 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:27 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22fb79-9fb7-40a1-8569-c56e45309247]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:54:27 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4f653f-424c-49fc-ba69-d026580d97d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48] added
Oct 25 22:54:27 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e2a82d-4c40-4a3c-96d9-44095f61658e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff553b7-9b55-448e-b02f-0908ec615144]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlayxuoG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlayxuoG" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[638872b1-b7fc-43bf-8107-d9b00c889274]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DlayxuoG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84168ad4-1d74-43b6-bbff-5051d967f6be]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d08b5-01a9-426d-9a2b-cd2bfbc38229]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a636c1d-cd4d-4992-a1a7-eff80b7845d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260]
Oct 25 22:54:28 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260] successful.
Oct 25 22:54:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eca75b-427c-47c3-959a-37a95a6a74ad]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[542864d8-8cba-48bc-a77f-5e3230ffb9f2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:28 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d983a8-b54d-41bc-98ef-1efa176032d1]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlayxuoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23938356665393861', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938356665393861', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxLJFntg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:29 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:29 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:29 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a7a42-2fe9-4c6b-9d77-46376a88a5fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:54:29 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[198fafc2-99a4-4528-80f1-a81f8cd575ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2] added
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da390a-7aa4-48c8-a7d1-f0a0fd85ca7f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f83f186-db9e-450a-af5f-901780742c9f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxLJFntg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxLJFntg" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a52b0e-f88f-4bee-9f4e-f9637ea69e77]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxLJFntg'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b232b062-9b39-4263-8848-16434efe8a22]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d51ce6-e983-4022-a28d-f62cf615aa48]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed5de34-ec9b-498e-827a-e505a172785b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260]
Oct 25 22:54:29 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260] successful.
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0618606-51ae-420a-8b30-bb0e53f8712d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94349c2-43bc-445c-842b-281c331168a8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[301abad3-6ffd-47d2-82a1-99b8f10a436a]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxLJFntg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:54:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23532643936303139', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532643936303139', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmdDGXgM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:30 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:30 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:30 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6db4e4-5be2-41fd-97f6-758f60ff1ed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:54:30 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e896b33-b602-4327-8a23-1d54c8b9eeba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376] added
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e9b4db-03f5-4b7d-923b-d083e698d4f6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfa59dd-b347-4ba1-b2f3-096241335d4f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qmdDGXgM {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qmdDGXgM" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce129f2b-626d-42a1-a50b-6c241f5843fd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qmdDGXgM'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a719069-0e62-4785-9b01-4dc5935ec06f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[353176af-23c2-4f73-b8c5-ad54a8353581]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30507d30-a5de-4758-ae69-35c3d38b5039]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260]
Oct 25 22:54:30 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260] successful.
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fcde62-3e8a-49ca-aeaa-a88227196134]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d96016-d19c-4652-91e6-15087303129d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:54:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:54:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[407fa7b6-16f5-4a7f-99c5-ed5f96e86368]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmdDGXgM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23036633263636564', 'path': '/dev/sdf'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036633263636564', 'path': '/dev/sdf'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ad95b09-8a62-446b-b5cf-b42ff1093b41 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:54:32 user nova-compute[74507]:   <uuid>6ad95b09-8a62-446b-b5cf-b42ff1093b41</uuid>
Oct 25 22:54:32 user nova-compute[74507]:   <name>instance-00000013</name>
Oct 25 22:54:32 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:54:32 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:54:32 user nova-compute[74507]:   <metadata>
Oct 25 22:54:32 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:54:32 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:name>tempest-device-tagging-server-114677333</nova:name>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:54:27</nova:creationTime>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:54:32 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:54:32 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:owner>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:user uuid="4b0110d43df444a5952a733c8e365773">tempest-TaggedBootDevicesTest_v242-957934138-project-member</nova:user>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:project uuid="ef290b352cc6495a86059ef9d86fa0ba">tempest-TaggedBootDevicesTest_v242-957934138</nova:project>
Oct 25 22:54:32 user nova-compute[74507]:       </nova:owner>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:54:32 user nova-compute[74507]:       <nova:ports>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="3b853a11-eadd-472c-b5f3-79762da19260">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="e557d1e1-6eaa-42ec-af97-a2bb6fca1475">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="a36baeb0-a2c3-4cd3-b709-10508cdfbf7b">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="dbf87b02-650f-4609-ae6b-bcef8a2eaa00">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="0522c4c9-c604-4fca-859d-1eba394d7c5a">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:         <nova:port uuid="96d095b5-56cc-4d88-9e93-79cec1e314bc">
Oct 25 22:54:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 22:54:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:54:32 user nova-compute[74507]:       </nova:ports>
Oct 25 22:54:32 user nova-compute[74507]:     </nova:instance>
Oct 25 22:54:32 user nova-compute[74507]:   </metadata>
Oct 25 22:54:32 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:54:32 user nova-compute[74507]:     <system>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="serial">6ad95b09-8a62-446b-b5cf-b42ff1093b41</entry>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="uuid">6ad95b09-8a62-446b-b5cf-b42ff1093b41</entry>
Oct 25 22:54:32 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:54:32 user nova-compute[74507]:     </system>
Oct 25 22:54:32 user nova-compute[74507]:   </sysinfo>
Oct 25 22:54:32 user nova-compute[74507]:   <os>
Oct 25 22:54:32 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:54:32 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:54:32 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:54:32 user nova-compute[74507]:   </os>
Oct 25 22:54:32 user nova-compute[74507]:   <features>
Oct 25 22:54:32 user nova-compute[74507]:     <acpi/>
Oct 25 22:54:32 user nova-compute[74507]:     <apic/>
Oct 25 22:54:32 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:54:32 user nova-compute[74507]:   </features>
Oct 25 22:54:32 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:54:32 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:54:32 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:54:32 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:54:32 user nova-compute[74507]:   </clock>
Oct 25 22:54:32 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:54:32 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:54:32 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:54:32 user nova-compute[74507]:   </cpu>
Oct 25 22:54:32 user nova-compute[74507]:   <devices>
Oct 25 22:54:32 user nova-compute[74507]:     <disk type="file" device="cdrom">
Oct 25 22:54:32 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 22:54:32 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/disk.config"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="hda" bus="ide"/>
Oct 25 22:54:32 user nova-compute[74507]:     </disk>
Oct 25 22:54:32 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:54:32 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:54:32 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <serial>974f7054-1cbb-4488-9188-c43aa6684c48</serial>
Oct 25 22:54:32 user nova-compute[74507]:     </disk>
Oct 25 22:54:32 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:54:32 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:54:32 user nova-compute[74507]:       <source dev="/dev/sde"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <serial>113323cd-644a-4c9d-a441-817af37372f2</serial>
Oct 25 22:54:32 user nova-compute[74507]:     </disk>
Oct 25 22:54:32 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:54:32 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:54:32 user nova-compute[74507]:       <source dev="/dev/sdf"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="vdc" bus="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <serial>e4183cd1-bac0-44da-b5bf-50590f0aa376</serial>
Oct 25 22:54:32 user nova-compute[74507]:     </disk>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:7a:e1:97"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tap3b853a11-ea"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:ad:57:6a"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tape557d1e1-6e"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:6f:37:6d"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tapa36baeb0-a2"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:b0:9e:3d"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tapdbf87b02-65"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:44:e6:a5"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tap0522c4c9-c6"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:d6:74:8a"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tapacbb8fb9-3c"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:54:32 user nova-compute[74507]:       <mac address="fa:16:3e:00:bc:93"/>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:54:32 user nova-compute[74507]:       <target dev="tap96d095b5-56"/>
Oct 25 22:54:32 user nova-compute[74507]:     </interface>
Oct 25 22:54:32 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:54:32 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/console.log" append="off"/>
Oct 25 22:54:32 user nova-compute[74507]:     </serial>
Oct 25 22:54:32 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:54:32 user nova-compute[74507]:     <video>
Oct 25 22:54:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:54:32 user nova-compute[74507]:     </video>
Oct 25 22:54:32 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:54:32 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:54:32 user nova-compute[74507]:     </rng>
Oct 25 22:54:32 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:54:32 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:54:32 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:54:32 user nova-compute[74507]:     </memballoon>
Oct 25 22:54:32 user nova-compute[74507]:   </devices>
Oct 25 22:54:32 user nova-compute[74507]: </domain>
Oct 25 22:54:32 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af4e8ca0-1772-5ba0-8930-207c994f8e94', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b853a11-ea, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b853a11-ea, col_values=(('qos', UUID('cc291029-d28f-44ce-92b1-b5f1b7bad80e')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b853a11-ea, col_values=(('external_ids', {'iface-id': '3b853a11-eadd-472c-b5f3-79762da19260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:e1:97', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c27f6057-e223-578b-a31b-5f9a37c07a9d', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape557d1e1-6e, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape557d1e1-6e, col_values=(('qos', UUID('5ca236ce-feea-4bf3-a550-7809099b9eb4')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape557d1e1-6e, col_values=(('external_ids', {'iface-id': 'e557d1e1-6eaa-42ec-af97-a2bb6fca1475', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:57:6a', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb62e359-a306-5bef-a1c6-d6c0c689ea9d', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36baeb0-a2, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa36baeb0-a2, col_values=(('qos', UUID('0209629c-cbc3-44b3-9f8b-e238ca28757c')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa36baeb0-a2, col_values=(('external_ids', {'iface-id': 'a36baeb0-a2c3-4cd3-b709-10508cdfbf7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:37:6d', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ad75dc4-2aeb-5b6d-af4c-b643574f051c', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbf87b02-65, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbf87b02-65, col_values=(('qos', UUID('b4a07847-b101-4860-9119-fbbd0ec66d56')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbf87b02-65, col_values=(('external_ids', {'iface-id': 'dbf87b02-650f-4609-ae6b-bcef8a2eaa00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:9e:3d', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49f52599-1499-5968-a7f1-fbc393ae2107', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0522c4c9-c6, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0522c4c9-c6, col_values=(('qos', UUID('38b9c037-4366-4bd9-a2b9-5756edb653ca')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0522c4c9-c6, col_values=(('external_ids', {'iface-id': '0522c4c9-c604-4fca-859d-1eba394d7c5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e6:a5', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa8e3331-fdf4-5819-b210-2b263059d8fb', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacbb8fb9-3c, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacbb8fb9-3c, col_values=(('qos', UUID('197ebda7-a580-4efe-b071-64d3b4bfb6c8')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacbb8fb9-3c, col_values=(('external_ids', {'iface-id': 'acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:74:8a', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8895197f-5254-539d-9176-ad6391f96197', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d095b5-56, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d095b5-56, col_values=(('qos', UUID('8eeba4f2-ec22-4c22-9544-91cde8021fa4')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d095b5-56, col_values=(('external_ids', {'iface-id': '96d095b5-56cc-4d88-9e93-79cec1e314bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:bc:93', 'vm-uuid': '6ad95b09-8a62-446b-b5cf-b42ff1093b41'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:32 user nova-compute[74507]: INFO os_vif [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56')
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] No BDM found with device name hda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] No VIF found with MAC fa:16:3e:7a:e1:97, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:54:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] No VIF found with MAC fa:16:3e:44:e6:a5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:54:32 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Using config drive
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Creating config drive at /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/disk.config
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsx8t8v5 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsx8t8v5" returned: 0 in 0.052s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:34 user nova-compute[74507]: WARNING nova.compute.manager [req-c52e665b-03b0-4343-854b-3792deb65165 req-e6989826-9bbd-480c-b35c-02da1fdd7389 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 for instance with vm_state building and task_state spawning.
Oct 25 22:54:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:35 user nova-compute[74507]: WARNING nova.compute.manager [req-68bba9b1-0b32-46ad-91a7-e43063fdeeae req-37c359f0-75b4-41f9-ac50-f0995c9f18e6 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b for instance with vm_state building and task_state spawning.
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:35 user nova-compute[74507]: WARNING nova.compute.manager [req-e47889c0-e710-4da5-a8e2-70cea32f8b82 req-d011f9e4-38b3-4ac5-b359-14ad3bae496b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 for instance with vm_state building and task_state spawning.
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:37 user nova-compute[74507]: WARNING nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 for instance with vm_state building and task_state spawning.
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:37 user nova-compute[74507]: WARNING nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 for instance with vm_state building and task_state spawning.
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:37 user nova-compute[74507]: WARNING nova.compute.manager [req-f03a93b1-f363-48c8-90f1-63802458a745 req-2c572d62-168a-45bc-85a5-8fd887d08a13 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 for instance with vm_state building and task_state spawning.
Oct 25 22:54:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-982e5f6e-0bf5-480a-8f7d-06eba43a8d1e req-56a4b4c3-2654-49ee-9443-bb2dcdd4a394 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-c982d387-3c40-4090-b622-70f6a9938ebe req-7b4a3a18-6509-4a4e-868f-5306537f709b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.compute.manager [req-9f5f691d-dd3f-4ee3-bc62-5775ab2a543e req-95964247-17d0-4932-ad0b-fda81e1f39c5 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc for instance with vm_state building and task_state spawning.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7146MB free_disk=25.042648315429688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance spawned successfully.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:39 user nova-compute[74507]: INFO nova.compute.manager [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Terminating instance
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:39 user nova-compute[74507]: INFO nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Took 11.98 seconds to spawn the instance on the hypervisor.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 3c5361aa-2b96-4c06-b93b-009858e427f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 89c463e4-ba80-4f08-a78c-5cf8754a1772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 6ad95b09-8a62-446b-b5cf-b42ff1093b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:54:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:39 user nova-compute[74507]: INFO nova.compute.manager [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Took 80.21 seconds to build instance.
Oct 25 22:54:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e6253037-d00d-4ce1-986a-1d04a00c0dec tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 80.321s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Instance destroyed successfully.
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lazy-loading 'resources' on Instance uuid 3c5361aa-2b96-4c06-b93b-009858e427f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1672474875',display_name='tempest-ServerActionsTestOtherB-server-1672474875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1672474875',id=4,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNKFa2OlNlHprukmQHj0OKC5yifEqZLLCVETY6cVL+aBN4oMlnYQ+ncKKufeU5bOPgacXtClEZPlTZYYXGbtvPHLuk9WxuewTDPJq4u+ItZNUFGnp4ZjWZpAn4qjipcvg==',key_name='tempest-keypair-249628865',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:52:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef98410fe55b43ed8778fc75104265b2',ramdisk_id='',reservation_id='r-rp7p8git',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1115493463',owner_user_name='tempest-ServerActionsTestOtherB-1115493463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625b3a2950ec4561a10239c20a13f93e',uuid=3c5361aa-2b96-4c06-b93b-009858e427f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converting VIF {"id": "41549664-f691-487a-b621-4498583fbb63", "address": "fa:16:3e:bf:24:13", "network": {"id": "e084604c-a202-46ff-8194-0af413a903d1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-945895027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef98410fe55b43ed8778fc75104265b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41549664-f6", "ovs_interfaceid": "41549664-f691-487a-b621-4498583fbb63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_vif [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41549664-f6, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5da35e0b-f581-4f9c-9a76-786a27f3d607) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:40 user nova-compute[74507]: INFO os_vif [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:24:13,bridge_name='br-int',has_traffic_filtering=True,id=41549664-f691-487a-b621-4498583fbb63,network=Network(e084604c-a202-46ff-8194-0af413a903d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41549664-f6')
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jICAgSwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:40 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ea409-025b-462f-930c-9046568d060d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:54:40 user nova-compute[74507]: No targets found.
Oct 25 22:54:40 user nova-compute[74507]: iSNS:
Oct 25 22:54:40 user nova-compute[74507]: No targets found.
Oct 25 22:54:40 user nova-compute[74507]: STATIC:
Oct 25 22:54:40 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:54:40 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:54:40 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:54:40 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e
Oct 25 22:54:40 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:54:40 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:54:40 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:54:40 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:54:40 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:54:40 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:54:40 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:54:40 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:54:40 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48
Oct 25 22:54:40 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:54:40 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:54:40 user nova-compute[74507]: FIRMWARE:
Oct 25 22:54:40 user nova-compute[74507]: No targets found.
Oct 25 22:54:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:54:40 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:54:40 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9022e-9f53-4475-a5f3-c34e1132f43a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d7cde-f53a-4b04-9c7a-27aa33566f2f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:54:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54658ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92580cd-9cec-443c-b5da-5003676ff662]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9507f72a-5ad1-40e4-9aac-799e5704ee52]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57d8d8-eba9-4781-979f-9b4666d9889a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c1d62-fa40-4e27-9c3d-5f94f26fd5f7]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edac94f-2b7e-4ffe-80ea-ef82dca9ce78]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a7bc0-b86a-4407-8f9c-30a7662e9f08]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260]
Oct 25 22:54:40 user nova-compute[74507]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e, portal: 172.16.0.220,3260] successful.
Oct 25 22:54:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea97423b-3596-4780-9ee1-50c4a1949c0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7920048-073e-4d11-914a-446b06241634]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] <== disconnect_volume: return (318ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:54:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Deleting instance files /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_del
Oct 25 22:54:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Deletion of /opt/stack/data/nova/instances/3c5361aa-2b96-4c06-b93b-009858e427f2_del complete
Oct 25 22:54:40 user nova-compute[74507]: INFO nova.compute.manager [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 25 22:54:40 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:54:40 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-unplugged-41549664-f691-487a-b621-4498583fbb63 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Acquiring lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] No waiting events found dispatching network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:54:41 user nova-compute[74507]: WARNING nova.compute.manager [req-3353459a-a804-43f6-9ce1-dc9285849a8e req-576d6c50-fd8e-4443-9136-dc09e07508cf service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received unexpected event network-vif-plugged-41549664-f691-487a-b621-4498583fbb63 for instance with vm_state active and task_state deleting.
Oct 25 22:54:41 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:41 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Took 1.11 seconds to deallocate network for instance.
Oct 25 22:54:42 user nova-compute[74507]: INFO nova.compute.manager [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Took 0.97 seconds to detach 1 volumes for instance.
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-cc759faa-55eb-455a-9ec3-0b1747998667 req-cd66831e-3d13-4008-9827-fa0f41490939 service nova] [instance: 3c5361aa-2b96-4c06-b93b-009858e427f2] Received event network-vif-deleted-41549664-f691-487a-b621-4498583fbb63 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:43 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Deleted allocations for instance 3c5361aa-2b96-4c06-b93b-009858e427f2
Oct 25 22:54:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c42d855f-2cd7-41dd-9ee6-75aa4281a58a tempest-ServerActionsTestOtherB-1115493463 tempest-ServerActionsTestOtherB-1115493463-project-member] Lock "3c5361aa-2b96-4c06-b93b-009858e427f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.133s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:47 user nova-compute[74507]: INFO nova.compute.manager [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Detaching volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:54:47 user nova-compute[74507]: INFO nova.virt.block_device [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Attempting to driver detach volume a547c2ab-ba7b-41ea-9227-6dc4b4861b36 from mountpoint /dev/vdb
Oct 25 22:54:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Attempting to detach device vdb from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:54:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:54:47 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:54:47 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:54:47 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:54:47 user nova-compute[74507]:   <serial>a547c2ab-ba7b-41ea-9227-6dc4b4861b36</serial>
Oct 25 22:54:47 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 22:54:47 user nova-compute[74507]: </disk>
Oct 25 22:54:47 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:54:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully detached device vdb from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the persistent domain config.
Oct 25 22:54:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:54:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:54:47 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:54:47 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:54:47 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:54:47 user nova-compute[74507]:   <serial>a547c2ab-ba7b-41ea-9227-6dc4b4861b36</serial>
Oct 25 22:54:47 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 22:54:47 user nova-compute[74507]: </disk>
Oct 25 22:54:47 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:54:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:54:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing instance network info cache due to event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] Acquiring lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] Acquired lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lazy-loading 'flavor' on Instance uuid 89c463e4-ba80-4f08-a78c-5cf8754a1772 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:52 user nova-compute[74507]: INFO nova.compute.manager [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Attaching volume 96ec99ec-f6c5-4908-8b86-036f881f5627 to /dev/vdb
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.utils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c25169-993b-4f99-82e4-78b06b8b3751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d3b65-e2bc-4e3f-b87a-937adcb741d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa17a943-a5c5-41b9-8ba0-de95b1816161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c2831-e6b8-41e4-83ff-23ab2289fe60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:54:52 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce575c34-557c-48d1-b798-64e5c9ed3c1e]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG os_brick.utils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updating existing volume attachment record: 8f014845-d3d2-44dc-937b-0992043b8d6b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updated VIF entry in instance network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating instance_info_cache with network_info: [{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fb54347-5691-4091-80d9-d236152cbf63 req-5af20a70-6955-4c77-a989-fa541b6259d1 service nova] Releasing lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:54:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:54:52 user nova-compute[74507]: INFO nova.compute.manager [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Attaching volume 740ac299-1cf1-41a0-8976-0360c44c3176 to /dev/vdb
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.utils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a08fd9-4a49-4f00-ac83-f64587871642]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2173392-13ad-4320-b712-0c5e237342f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98e9fd-a5c4-4ea6-8a56-62d895afb95d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce7bae-4f3c-413b-aeda-0fa0732b69d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:54:53 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:54:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec51597-8458-4b8a-90b1-063f0a6fc20e]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG os_brick.utils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:54:53 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating existing volume attachment record: 02e621f9-0888-4bc1-a650-adc99379886b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:54:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:54:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lazy-loading 'flavor' on Instance uuid cee2d99c-cce8-419f-91da-6523af9313de {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:02 user nova-compute[74507]: INFO nova.compute.manager [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Attaching volume 2ab30547-3fdd-4a8b-a032-e2424a24f46c to /dev/vdb
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.utils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2ead3-3de6-43ed-b6f4-4087c836c0f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee940fbe-7feb-4484-ae1c-ca81324c20e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[595af762-2e63-4fb5-912a-ad8a2514a1a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb28e9e-de10-4367-bf93-2d965bdc707a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:55:03 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:55:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a438a-3c93-4b2e-a6e0-3da721d966ee]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG os_brick.utils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:03 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating existing volume attachment record: f904fb51-a9b1-4a30-bc2d-4d2c90ac08f8 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:55:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07808568-ed98-469b-a7d7-f5791e93c535 is timed out.
Oct 25 22:55:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully detached device vdb from instance 07808568-ed98-469b-a7d7-f5791e93c535 from the live domain config.
Oct 25 22:55:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LhdOazrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[137efa1d-b992-4bcf-8ece-20cf13e55e48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:55:07 user nova-compute[74507]: No targets found.
Oct 25 22:55:07 user nova-compute[74507]: iSNS:
Oct 25 22:55:07 user nova-compute[74507]: No targets found.
Oct 25 22:55:07 user nova-compute[74507]: STATIC:
Oct 25 22:55:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36
Oct 25 22:55:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:55:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:55:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48
Oct 25 22:55:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:07 user nova-compute[74507]: FIRMWARE:
Oct 25 22:55:07 user nova-compute[74507]: No targets found.
Oct 25 22:55:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:55:07 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:55:07 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd7d63e-0d22-474c-81ca-48b2acba6ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f530b30-3197-4569-85c9-201e9a240b03]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546dcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa70ef-e346-4c64-bdd2-06ba4f083bb8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05062e0-2e13-4910-8342-dda62d84e465]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bebfb5-14fd-4ba5-af77-7218e912ecb1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc1920-bde9-41a4-9caf-fb59be3aa15a]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd99f12-1c5f-4736-bb1c-7f252263147a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32b353-9a5c-4fdf-b34a-7b52cb0b52a5]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260]
Oct 25 22:55:08 user nova-compute[74507]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36, portal: 172.16.0.220,3260] successful.
Oct 25 22:55:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a547c2ab-ba7b-41ea-9227-6dc4b4861b36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc57345-6e6a-414e-ae93-3b97720fb714]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== disconnect_volume: return (331ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:55:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uskZYVrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:13 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157b3b6-5336-4ec1-8e82-a4d8ac75a205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:55:13 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cfbc5c-7454-4e6d-b3e4-ed2e8d1075b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627] added
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db1398b-d32a-4e90-a636-d74d7999ffe4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2b893-c2fb-40d8-81d6-e2c49c68c19e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uskZYVrF {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uskZYVrF" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d88886-b581-4e62-9ede-4f2ebec4711a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uskZYVrF'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4137d5f0-3205-426f-9a99-ffd4433b6973]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a53a8a9-53b2-491a-acca-ae4f442919ed]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc437f-6db3-4582-950e-e59102ebcbfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260]
Oct 25 22:55:13 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260] successful.
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ffc902-4200-41a0-bef1-3f6805c1ef35]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a518f4-d1b0-4ceb-8c74-1c3d69f3cb76]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f7f06-3661-4e53-b417-d746607290d3]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLGqWiwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'flavor' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2bb75f77-59dd-49a1-b210-53905174fb26 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.260s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uskZYVrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26364346538303037', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364346538303037', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.708s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:14 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lazy-loading 'flavor' on Instance uuid 89c463e4-ba80-4f08-a78c-5cf8754a1772 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc26a3-48d0-4485-b4bd-dd33cac1cf0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:55:14 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:55:14 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:55:14 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 22:55:14 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:55:14 user nova-compute[74507]:   <serial>96ec99ec-f6c5-4908-8b86-036f881f5627</serial>
Oct 25 22:55:14 user nova-compute[74507]: </disk>
Oct 25 22:55:14 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6cbc31-fa57-4f31-8495-98b4fe7bf28b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176] added
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89770b43-9f4b-4984-8679-4f83b91ab920]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7856501-2ee8-4c2a-958a-61da355af6a7]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLGqWiwH {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLGqWiwH" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d3d8d-5db5-4b27-ac73-b19680476434]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLGqWiwH'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a0cfa-9c64-4466-b319-b3b92a98936a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d359692-b307-45e1-9080-b4737289536a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.volume.cinder [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Update attachment failed for attachment f904fb51-a9b1-4a30-bc2d-4d2c90ac08f8. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Failed to attach 2ab30547-3fdd-4a8b-a032-e2424a24f46c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de] Traceback (most recent call last):
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     self._do_attach(context, instance, volume, volume_api,
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     self._volume_attach(context, volume, connector, instance,
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     connection_info = volume_api.attachment_update(
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     res = method(self, ctx, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     return method.func(obj, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     resp = self._update('/attachments/%s' % id, body)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     return self.request(url, method, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de]     raise exceptions.from_response(resp, body)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91)
Oct 25 22:55:14 user nova-compute[74507]: ERROR nova.compute.manager [instance: cee2d99c-cce8-419f-91da-6523af9313de] 
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e945c04-166a-48a7-ba9a-21e820f92442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260]
Oct 25 22:55:14 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260] successful.
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74b826-0ac7-44a9-be13-dd3d5fbb256d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e57447-95cc-441c-904a-a854a3416df6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.049s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6f956b-db54-4eff-8a2d-2625cc5e0ccd]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:55:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLGqWiwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server [None req-9c52a34c-a6e6-4efe-872d-9541325df3ce tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2b65f38b-f984-4a75-8f8b-841c7745af91)
Oct 25 22:55:14 user nova-compute[74507]: ERROR oslo_messaging.rpc.server 
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] No VIF found with MAC fa:16:3e:81:9b:d3, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ab54d6dd-1a69-4c78-b2a8-5030c6203b7c tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.696s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:15 user nova-compute[74507]: INFO nova.compute.manager [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Terminating instance
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== connect_volume: return (2085ms) {'type': 'block', 'scsi_wwn': '23133626462623261', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133626462623261', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.objects.instance [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:55:15 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:55:15 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:55:15 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:55:15 user nova-compute[74507]:   <serial>740ac299-1cf1-41a0-8976-0360c44c3176</serial>
Oct 25 22:55:15 user nova-compute[74507]: </disk>
Oct 25 22:55:15 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-unplugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-unplugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-7a0e84e3-9778-471f-874a-6e5132ef9296 req-2f6e8d74-a283-4472-8efa-e592f68bbe9f service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-unplugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] No VIF found with MAC fa:16:3e:10:a7:c4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-24dfb286-0d31-4db2-9206-f97c87afb33e tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.547s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Instance destroyed successfully.
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lazy-loading 'resources' on Instance uuid 89c463e4-ba80-4f08-a78c-5cf8754a1772 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1183618097',display_name='tempest-DeleteServersTestJSON-server-1183618097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1183618097',id=17,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:53:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8abfbc11474245c08187249001cf8854',ramdisk_id='',reservation_id='r-l9dvu9vw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1065785402',owner_user_name='tempest-DeleteServersTestJSON-1065785402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:53:04Z,user_data=None,user_id='4ac1ba6d1a3440f0adeb4484b088355d',uuid=89c463e4-ba80-4f08-a78c-5cf8754a1772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converting VIF {"id": "8218b81a-9297-4c14-b5d0-58537beb970f", "address": "fa:16:3e:81:9b:d3", "network": {"id": "eea3324a-2b27-437e-8d50-a80397b3a4be", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1727636789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8abfbc11474245c08187249001cf8854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8218b81a-92", "ovs_interfaceid": "8218b81a-9297-4c14-b5d0-58537beb970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_vif [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8218b81a-92, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e3daa09-1923-4dd6-a1a4-d1f5fe5c6c3b) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:55:16 user nova-compute[74507]: INFO os_vif [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:9b:d3,bridge_name='br-int',has_traffic_filtering=True,id=8218b81a-9297-4c14-b5d0-58537beb970f,network=Network(eea3324a-2b27-437e-8d50-a80397b3a4be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8218b81a-92')
Oct 25 22:55:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uskZYVrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:16 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b38cf3-77df-4034-9ee8-3c18e0f6c0c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:55:16 user nova-compute[74507]: No targets found.
Oct 25 22:55:16 user nova-compute[74507]: iSNS:
Oct 25 22:55:16 user nova-compute[74507]: No targets found.
Oct 25 22:55:16 user nova-compute[74507]: STATIC:
Oct 25 22:55:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:55:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176
Oct 25 22:55:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:55:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627
Oct 25 22:55:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48
Oct 25 22:55:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:16 user nova-compute[74507]: FIRMWARE:
Oct 25 22:55:16 user nova-compute[74507]: No targets found.
Oct 25 22:55:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:55:16 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:55:16 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5534b68-939c-4736-9ff9-138e306403e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd045c-53ed-427d-9d0b-230334864c68]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc6477-f6c9-429f-9fa1-7510e1ca8e3a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11284e67-1ba0-4553-814a-0bf597dadad1]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d54a73-bfe9-4d65-aa35-c29ed9125208]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ae375-feaf-4434-b50e-ecd87d0ecd29]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:55:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72afeb-9f20-4698-838e-4463de7bfac3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4790e-99dd-4877-96a9-695ef16c4108]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260]
Oct 25 22:55:17 user nova-compute[74507]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627, portal: 172.16.0.220,3260] successful.
Oct 25 22:55:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96ec99ec-f6c5-4908-8b86-036f881f5627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3be7ad-9b12-485f-97e3-0058c97f6d2f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] <== disconnect_volume: return (375ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:55:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Deleting instance files /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772_del
Oct 25 22:55:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Deletion of /opt/stack/data/nova/instances/89c463e4-ba80-4f08-a78c-5cf8754a1772_del complete
Oct 25 22:55:17 user nova-compute[74507]: INFO nova.compute.manager [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 25 22:55:17 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:17 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Took 0.50 seconds to deallocate network for instance.
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-eaef0527-0530-48ea-a7b4-ef6cf99f4230 req-6e3abd50-fa07-42b6-9ba6-aaca9a266f8d service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-deleted-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:17 user nova-compute[74507]: INFO nova.compute.manager [req-eaef0527-0530-48ea-a7b4-ef6cf99f4230 req-6e3abd50-fa07-42b6-9ba6-aaca9a266f8d service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Neutron deleted interface 8218b81a-9297-4c14-b5d0-58537beb970f; detaching it from the instance and deleting it from the info cache
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-eaef0527-0530-48ea-a7b4-ef6cf99f4230 req-6e3abd50-fa07-42b6-9ba6-aaca9a266f8d service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-eaef0527-0530-48ea-a7b4-ef6cf99f4230 req-6e3abd50-fa07-42b6-9ba6-aaca9a266f8d service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Detach interface failed, port_id=8218b81a-9297-4c14-b5d0-58537beb970f, reason: Instance 89c463e4-ba80-4f08-a78c-5cf8754a1772 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:18 user nova-compute[74507]: INFO nova.compute.manager [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Detaching volume 740ac299-1cf1-41a0-8976-0360c44c3176
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:18 user nova-compute[74507]: WARNING nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received unexpected event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with vm_state active and task_state deleting.
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:18 user nova-compute[74507]: WARNING nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received unexpected event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with vm_state active and task_state deleting.
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Acquiring lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] No waiting events found dispatching network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:18 user nova-compute[74507]: WARNING nova.compute.manager [req-55ec7d9a-dea4-4186-ac09-40c9b81fe2f5 req-2458d592-8eaf-4e3f-8492-09f59aa884b2 service nova] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Received unexpected event network-vif-plugged-8218b81a-9297-4c14-b5d0-58537beb970f for instance with vm_state active and task_state deleting.
Oct 25 22:55:18 user nova-compute[74507]: INFO nova.virt.block_device [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Attempting to driver detach volume 740ac299-1cf1-41a0-8976-0360c44c3176 from mountpoint /dev/vdb
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Attempting to detach device vdb from instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:55:18 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:55:18 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:55:18 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:55:18 user nova-compute[74507]:   <serial>740ac299-1cf1-41a0-8976-0360c44c3176</serial>
Oct 25 22:55:18 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:55:18 user nova-compute[74507]: </disk>
Oct 25 22:55:18 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:55:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully detached device vdb from instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 from the persistent domain config.
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:55:18 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:55:18 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:55:18 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:55:18 user nova-compute[74507]:   <serial>740ac299-1cf1-41a0-8976-0360c44c3176</serial>
Oct 25 22:55:18 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:55:18 user nova-compute[74507]: </disk>
Oct 25 22:55:18 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:55:18 user nova-compute[74507]: INFO nova.compute.manager [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] [instance: 89c463e4-ba80-4f08-a78c-5cf8754a1772] Took 0.86 seconds to detach 1 volumes for instance.
Oct 25 22:55:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:19 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:55:19 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:55:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:19 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Deleted allocations for instance 89c463e4-ba80-4f08-a78c-5cf8754a1772
Oct 25 22:55:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f07868f0-857b-41bb-9c3a-dce3807bd41a tempest-DeleteServersTestJSON-1065785402 tempest-DeleteServersTestJSON-1065785402-project-member] Lock "89c463e4-ba80-4f08-a78c-5cf8754a1772" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.509s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:55:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:55:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:55:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:55:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:55:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:55:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:55:37 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.090679168701172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:37 user nova-compute[74507]: INFO nova.compute.manager [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Terminating instance
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 07808568-ed98-469b-a7d7-f5791e93c535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 6ad95b09-8a62-446b-b5cf-b42ff1093b41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:55:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-62f10d36-9973-457a-bb9d-a9d9d3deee16 req-319f41b6-54db-43e3-93dd-1d08e4a1fdcf service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-unplugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Instance destroyed successfully.
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'resources' on Instance uuid 07808568-ed98-469b-a7d7-f5791e93c535 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1438832574',display_name='tempest-ServerActionsTestOtherA-server-38949155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1438832574',id=13,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIahewYDjCWTZwhsZY1JjNe6rDckoNG1v1J364eodhN3Cv+DgLwLVmGDzayG2fYJ6IwenJ23MvNl9T3JHlhQuAI1b71SoacQ4Q4PVr6hAiPOjjyNWzcSebEBybsucrxNlw==',key_name='tempest-keypair-428550049',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:52:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-9r0ap0ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=07808568-ed98-469b-a7d7-f5791e93c535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "address": "fa:16:3e:e7:7b:bc", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d8a8c8f-22", "ovs_interfaceid": "1d8a8c8f-2240-4cbe-8a2f-915b0be10d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_vif [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d8a8c8f-22, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48e985cd-f391-4414-9bfd-f53645a7f03a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:38 user nova-compute[74507]: INFO os_vif [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:7b:bc,bridge_name='br-int',has_traffic_filtering=True,id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d8a8c8f-22')
Oct 25 22:55:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Deleting instance files /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535_del
Oct 25 22:55:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Deletion of /opt/stack/data/nova/instances/07808568-ed98-469b-a7d7-f5791e93c535_del complete
Oct 25 22:55:38 user nova-compute[74507]: INFO nova.compute.manager [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:55:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 is timed out.
Oct 25 22:55:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully detached device vdb from instance 2db4ebfb-3ff8-442e-b971-0a3d37861715 from the live domain config.
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLGqWiwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:38 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b9c98c-57c4-4ac5-9139-b4eb1392093c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:55:38 user nova-compute[74507]: No targets found.
Oct 25 22:55:38 user nova-compute[74507]: iSNS:
Oct 25 22:55:38 user nova-compute[74507]: No targets found.
Oct 25 22:55:38 user nova-compute[74507]: STATIC:
Oct 25 22:55:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:55:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176
Oct 25 22:55:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:55:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48
Oct 25 22:55:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:55:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:55:38 user nova-compute[74507]: FIRMWARE:
Oct 25 22:55:38 user nova-compute[74507]: No targets found.
Oct 25 22:55:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:55:38 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:55:38 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[426ff104-2951-419f-98fa-195f877f1ad1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e47f7c3-ac0c-4250-b122-2e3e517a51ff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 (non-flash)
Oct 25 22:55:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5465a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9699cb14-59c3-4438-bcf0-aaff7954e3e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eaef10-b95f-42d8-adbc-3d989db597fe]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83fa29d-1450-43dd-8bd1-c0ccf8aea2cc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110ed08-3414-4f7a-a213-b57d6e274e5e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd981a8-7c13-4584-8cd5-24735757e1e3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf80a38-286a-420e-b740-4c0bc02c2bfe]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260]
Oct 25 22:55:38 user nova-compute[74507]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176, portal: 172.16.0.220,3260] successful.
Oct 25 22:55:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:740ac299-1cf1-41a0-8976-0360c44c3176 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4875f8b-d391-4bbb-bf64-4d2bf48dcc40]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] <== disconnect_volume: return (318ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:39 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Took 0.72 seconds to deallocate network for instance.
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-637357ed-9fb5-4acc-b2b2-1d975c112c36 req-aaaa5e89-a5c1-49b7-aae2-1ca8925c26c0 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-deleted-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:39 user nova-compute[74507]: INFO nova.compute.manager [req-637357ed-9fb5-4acc-b2b2-1d975c112c36 req-aaaa5e89-a5c1-49b7-aae2-1ca8925c26c0 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Neutron deleted interface 1d8a8c8f-2240-4cbe-8a2f-915b0be10d76; detaching it from the instance and deleting it from the info cache
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.network.neutron [req-637357ed-9fb5-4acc-b2b2-1d975c112c36 req-aaaa5e89-a5c1-49b7-aae2-1ca8925c26c0 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-637357ed-9fb5-4acc-b2b2-1d975c112c36 req-aaaa5e89-a5c1-49b7-aae2-1ca8925c26c0 service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Detach interface failed, port_id=1d8a8c8f-2240-4cbe-8a2f-915b0be10d76, reason: Instance 07808568-ed98-469b-a7d7-f5791e93c535 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:55:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:39 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Deleted allocations for instance 07808568-ed98-469b-a7d7-f5791e93c535
Oct 25 22:55:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f9e18cc9-92c1-47e4-a270-ee20e32a8e01 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "07808568-ed98-469b-a7d7-f5791e93c535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] Acquiring lock "07808568-ed98-469b-a7d7-f5791e93c535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] Lock "07808568-ed98-469b-a7d7-f5791e93c535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] No waiting events found dispatching network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:55:40 user nova-compute[74507]: WARNING nova.compute.manager [req-5ef85317-0737-4a14-b73e-d225a7e0cddd req-dd92b654-cc6d-455d-9e85-f2f1e7c1ad1b service nova] [instance: 07808568-ed98-469b-a7d7-f5791e93c535] Received unexpected event network-vif-plugged-1d8a8c8f-2240-4cbe-8a2f-915b0be10d76 for instance with vm_state deleted and task_state None.
Oct 25 22:55:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:55:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:55:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:55:45 user nova-compute[74507]: INFO nova.compute.manager [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] instance snapshotting
Oct 25 22:55:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Beginning live snapshot process
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371.delta 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371.delta 1073741824" returned: 0 in 0.051s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 22:55:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:55:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 22:55:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 22:55:47 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:55:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371.delta /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371.delta /opt/stack/data/nova/instances/snapshots/tmpdon3pdr7/fa70e980c6a24128a39d9edc096b1371" returned: 0 in 0.634s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Snapshot extracted, beginning image upload
Oct 25 22:55:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'flavor' on Instance uuid 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f264f33c-2470-4b89-bed7-6c6be64dbf9c tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.354s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:55:51 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Snapshot image upload complete
Oct 25 22:55:51 user nova-compute[74507]: INFO nova.compute.manager [None req-4e6f745d-e559-486b-a17d-db3c2b359277 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Took 5.89 seconds to snapshot the instance on the hypervisor.
Oct 25 22:55:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing instance network info cache due to event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'flavor' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updated VIF entry in instance network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.196s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0ad8f704-e7d9-4f96-b321-0d1087e7ad1e req-59664fe5-59df-4689-8e68-2a6fd4ce3e15 service nova] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:55:59 user nova-compute[74507]: INFO nova.compute.manager [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Attaching volume bc058bf1-3035-4490-80b9-c6c8313c6c04 to /dev/vdb
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778b911-bc98-44c6-b9c2-a6a62876be5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24b7db1-680e-4de2-a140-b3dabe315863]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d49575-6413-404a-bd7c-027628044dea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fdf9c6-b463-4fa3-b5c5-140b98e0d3ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:55:59 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:55:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fda094-76ea-46c1-8f9a-930d03304953]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:55:59 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating existing volume attachment record: 7bee64ec-0c6f-46ba-b84b-96818c3d497c {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-changed-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing instance network info cache due to event network-changed-3b853a11-eadd-472c-b5f3-79762da19260. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] Acquiring lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] Acquired lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Refreshing network info cache for port 3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:56:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updated VIF entry in instance network info cache for port 3b853a11-eadd-472c-b5f3-79762da19260. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:56:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39a5f29d-ae3f-4653-b329-c900e90f4214 req-3ea0351d-81fc-41bf-9ce6-3c0ea0dd927b service nova] Releasing lock "refresh_cache-6ad95b09-8a62-446b-b5cf-b42ff1093b41" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:03 user nova-compute[74507]: INFO nova.compute.manager [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Terminating instance
Oct 25 22:56:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e6bba23-781b-45f0-86d2-b7bd6aa842be req-1f1cb363-383c-43e8-b872-e8769ebf8dcc service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-3b853a11-eadd-472c-b5f3-79762da19260 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-6de438b0-576b-45e8-a2bd-ff61bc1949ad req-01b3e66e-faa1-4162-a34a-d6370dffe5c9 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-24a25bf2-8a15-4ba7-a31f-24b8df3e1935 req-738ee5a1-db92-48b7-b8ca-9108ca7cc807 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Instance destroyed successfully.
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lazy-loading 'resources' on Instance uuid 6ad95b09-8a62-446b-b5cf-b42ff1093b41 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b853a11-ea, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc291029-d28f-44ce-92b1-b5f1b7bad80e) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:e1:97,bridge_name='br-int',has_traffic_filtering=True,id=3b853a11-eadd-472c-b5f3-79762da19260,network=Network(f26a90dd-bbb6-4b01-90a4-89d86d4cc163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b853a11-ea')
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape557d1e1-6e, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ca236ce-feea-4bf3-a550-7809099b9eb4) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:57:6a,bridge_name='br-int',has_traffic_filtering=True,id=e557d1e1-6eaa-42ec-af97-a2bb6fca1475,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape557d1e1-6e')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36baeb0-a2, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0209629c-cbc3-44b3-9f8b-e238ca28757c) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:37:6d,bridge_name='br-int',has_traffic_filtering=True,id=a36baeb0-a2c3-4cd3-b709-10508cdfbf7b,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36baeb0-a2')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "address": "fa:16:3e:b0:9e:3d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf87b02-65", "ovs_interfaceid": "dbf87b02-650f-4609-ae6b-bcef8a2eaa00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbf87b02-65, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4a07847-b101-4860-9119-fbbd0ec66d56) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9e:3d,bridge_name='br-int',has_traffic_filtering=True,id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf87b02-65')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0522c4c9-c6, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38b9c037-4366-4bd9-a2b9-5756edb653ca) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e6:a5,bridge_name='br-int',has_traffic_filtering=True,id=0522c4c9-c604-4fca-859d-1eba394d7c5a,network=Network(278138d6-f258-4f93-86ae-b331bb2a988c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0522c4c9-c6')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacbb8fb9-3c, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=197ebda7-a580-4efe-b071-64d3b4bfb6c8) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:74:8a,bridge_name='br-int',has_traffic_filtering=True,id=acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbb8fb9-3c')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T22:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-114677333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-114677333',id=19,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe2bEd81ZoA17hU3cciyxrX47IxigmJiSva5feCzg3kFaTC0Dq3JXOW7FonDtGl8TxZe+UFlfNEhQTcILiRjpYYS6UG9onk4cgMwmJDU7wJJHkpJmQxzDHfzmbtn8hnyw==',key_name='tempest-keypair-438541967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef290b352cc6495a86059ef9d86fa0ba',ramdisk_id='',reservation_id='r-nk61qfoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-957934138',owner_user_name='tempest-TaggedBootDevicesTest_v242-957934138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b0110d43df444a5952a733c8e365773',uuid=6ad95b09-8a62-446b-b5cf-b42ff1093b41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converting VIF {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d095b5-56, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eeba4f2-ec22-4c22-9544-91cde8021fa4) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: INFO os_vif [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:93,bridge_name='br-int',has_traffic_filtering=True,id=96d095b5-56cc-4d88-9e93-79cec1e314bc,network=Network(ced0378d-cf25-4645-981c-fb121542af56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d095b5-56')
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlayxuoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc5876-5e9b-400f-a49a-130b5cff2b82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]: iSNS:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]: STATIC:
Oct 25 22:56:06 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:56:06 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:06 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:06 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:56:06 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:06 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:06 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48
Oct 25 22:56:06 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:06 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:06 user nova-compute[74507]: FIRMWARE:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:56:06 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:56:06 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a244c0-4d37-422e-b896-c8091dbd9dae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[754cd141-23b6-4f1c-bfe0-e361f195cb83]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64306f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6195ef5a-51b1-4925-850d-98ba618dd5fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d8d9f1-2dc9-488e-9f3c-fa4c0f3b6561]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0964461-ec29-47d3-9283-d3a1a7500f41]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-3b853a11-eadd-472c-b5f3-79762da19260 for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-e557d1e1-6eaa-42ec-af97-a2bb6fca1475 for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-96d095b5-56cc-4d88-9e93-79cec1e314bc for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-ed417d67-8a5a-4bf9-99c6-59bae8152b89 req-e3be82ce-8b4c-469c-b901-4f4c963f4b17 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-96d095b5-56cc-4d88-9e93-79cec1e314bc for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f41ab0-0f41-4713-b2f1-f5b05a0728b9]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76efd21b-bb39-4931-9416-961b933898f6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: INFO nova.compute.manager [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Terminating instance
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-a36baeb0-a2c3-4cd3-b709-10508cdfbf7b for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-3a86784e-e36a-4fa5-a178-23ce0c4b9b78 req-c6ec6f44-d894-4f8b-9608-ad8cec2bd285 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b71cf5-2355-45ae-8d01-929661ca110b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260]
Oct 25 22:56:06 user nova-compute[74507]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48, portal: 172.16.0.220,3260] successful.
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:974f7054-1cbb-4488-9188-c43aa6684c48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765986b-59e0-42ea-802e-9ebf06439dbb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== disconnect_volume: return (342ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxLJFntg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52ce8e-a419-40ca-952d-ea39d136a1d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]: iSNS:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]: STATIC:
Oct 25 22:56:06 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2
Oct 25 22:56:06 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:06 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:06 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:56:06 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:06 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:06 user nova-compute[74507]: FIRMWARE:
Oct 25 22:56:06 user nova-compute[74507]: No targets found.
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:56:06 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:56:06 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a2007-baff-409e-a7b0-8005a09fd9ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-unplugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-unplugged-0522c4c9-c604-4fca-859d-1eba394d7c5a for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Acquiring lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] No waiting events found dispatching network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:06 user nova-compute[74507]: WARNING nova.compute.manager [req-113b6f92-e6c9-4a12-9d6f-b72bc73be003 req-c680afd7-f85c-453f-8808-f6e6da298302 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received unexpected event network-vif-plugged-0522c4c9-c604-4fca-859d-1eba394d7c5a for instance with vm_state active and task_state deleting.
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144d0ee-7a43-412c-a40b-088f365d8226]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:06 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54476200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca1525-cfd6-47e1-813d-95bc8e4188d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf4837-4465-45aa-af08-fcc9c2c826c4]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44163c4c-e013-4237-ba31-0ac92b953bab]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5576ed13-1be4-4288-9069-3eb6a426d076]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[30107c12-a86d-4e9f-9d15-6ede6c71a3a0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad4a15a-d013-488a-81aa-99fcfa560cc5]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260]
Oct 25 22:56:07 user nova-compute[74507]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2, portal: 172.16.0.220,3260] successful.
Oct 25 22:56:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113323cd-644a-4c9d-a441-817af37372f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6427e8f3-621c-48ed-a634-1913f22f3198]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== disconnect_volume: return (379ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qmdDGXgM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:56:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe16ee17-c71b-42f9-a17a-4bccff202201]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:56:07 user nova-compute[74507]: No targets found.
Oct 25 22:56:07 user nova-compute[74507]: iSNS:
Oct 25 22:56:07 user nova-compute[74507]: No targets found.
Oct 25 22:56:07 user nova-compute[74507]: STATIC:
Oct 25 22:56:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376
Oct 25 22:56:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:56:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:56:07 user nova-compute[74507]: FIRMWARE:
Oct 25 22:56:07 user nova-compute[74507]: No targets found.
Oct 25 22:56:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:56:07 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:56:07 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dee04c-32e5-4eb5-bc0c-c5981d21c086]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[010aba96-894b-4201-8e0f-a2019e11baa6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 (non-flash)
Oct 25 22:56:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b544763b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376'): ({'sdf'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Removing single pathed devices sdf {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7aaaac-9230-485f-bc65-a5ebd3d0f166]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[651eba08-056e-4cb6-874e-c421e1365d9a]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Flushing IO for device /dev/sdf {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d2b265-357c-460f-a232-854dcdac2557]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6df8ba-4055-4d2c-96e8-8de8948f1d0f]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32dcc6b-9d99-4033-a094-302ba725c333]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Instance destroyed successfully.
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.objects.instance [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'resources' on Instance uuid 85d61c17-cfbd-4e09-8bea-04b71f28b94f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-962271633',display_name='tempest-AttachVolumeTestJSON-server-962271633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-962271633',id=5,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWvaFX1dPWkwfOrS6+Ik7Hs1Ebyf+rlggdAdAqtGdidXWT3lwPjDvsr5Cx0H6rurEeanZBc/TUv9Si4vrcJqtdVuVSQelkZr4K4TLKjW4uJFlWvJOFZGWHm3KIXi4YF1Q==',key_name='tempest-keypair-1891491358',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-wqy1vfzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=85d61c17-cfbd-4e09-8bea-04b71f28b94f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "address": "fa:16:3e:e7:ff:6d", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76e79bc5-63", "ovs_interfaceid": "76e79bc5-6314-4fde-bb5e-9541d1a48274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_vif [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec26a1d9-a60c-4e74-82a6-4c68a8b4046b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260]
Oct 25 22:56:07 user nova-compute[74507]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376, portal: 172.16.0.220,3260] successful.
Oct 25 22:56:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76e79bc5-63, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b12950f7-a2f0-45dd-a846-ddffeb175b11) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:07 user nova-compute[74507]: INFO os_vif [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ff:6d,bridge_name='br-int',has_traffic_filtering=True,id=76e79bc5-6314-4fde-bb5e-9541d1a48274,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76e79bc5-63')
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Deleting instance files /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f_del
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Deletion of /opt/stack/data/nova/instances/85d61c17-cfbd-4e09-8bea-04b71f28b94f_del complete
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4183cd1-bac0-44da-b5bf-50590f0aa376 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[930955e0-db2c-44c7-ab28-ed3a1a303068]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] <== disconnect_volume: return (379ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Deleting instance files /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41_del
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Deletion of /opt/stack/data/nova/instances/6ad95b09-8a62-446b-b5cf-b42ff1093b41_del complete
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.compute.manager [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:56:07 user nova-compute[74507]: INFO nova.compute.manager [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Took 3.50 seconds to destroy the instance on the hypervisor.
Oct 25 22:56:07 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:56:07 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:08 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Took 0.96 seconds to deallocate network for instance.
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-unplugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Acquiring lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] No waiting events found dispatching network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:08 user nova-compute[74507]: WARNING nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received unexpected event network-vif-plugged-76e79bc5-6314-4fde-bb5e-9541d1a48274 for instance with vm_state active and task_state deleting.
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6aba5f4-2848-4d88-87e8-ec3108faa40a req-70e45b83-cec8-4c48-911a-5c861971a287 service nova] [instance: 85d61c17-cfbd-4e09-8bea-04b71f28b94f] Received event network-vif-deleted-76e79bc5-6314-4fde-bb5e-9541d1a48274 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing instance network info cache due to event network-changed-9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] Acquiring lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] Acquired lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.neutron [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Refreshing network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Deleted allocations for instance 85d61c17-cfbd-4e09-8bea-04b71f28b94f
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.compute.manager [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Terminating instance
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d5ad22c1-1f05-4006-94fb-7538755bc7da tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "85d61c17-cfbd-4e09-8bea-04b71f28b94f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-461f8035-de57-4b68-81be-8b2e9b64901e req-301c051f-40b5-4b92-b51f-86376199eca8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-deleted-dbf87b02-650f-4609-ae6b-bcef8a2eaa00 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.compute.manager [req-461f8035-de57-4b68-81be-8b2e9b64901e req-301c051f-40b5-4b92-b51f-86376199eca8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Neutron deleted interface dbf87b02-650f-4609-ae6b-bcef8a2eaa00; detaching it from the instance and deleting it from the info cache
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.neutron [req-461f8035-de57-4b68-81be-8b2e9b64901e req-301c051f-40b5-4b92-b51f-86376199eca8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [{"id": "3b853a11-eadd-472c-b5f3-79762da19260", "address": "fa:16:3e:7a:e1:97", "network": {"id": "f26a90dd-bbb6-4b01-90a4-89d86d4cc163", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1415198970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b853a11-ea", "ovs_interfaceid": "3b853a11-eadd-472c-b5f3-79762da19260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "address": "fa:16:3e:ad:57:6a", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape557d1e1-6e", "ovs_interfaceid": "e557d1e1-6eaa-42ec-af97-a2bb6fca1475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "address": "fa:16:3e:6f:37:6d", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36baeb0-a2", "ovs_interfaceid": "a36baeb0-a2c3-4cd3-b709-10508cdfbf7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "address": "fa:16:3e:44:e6:a5", "network": {"id": "278138d6-f258-4f93-86ae-b331bb2a988c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1230478641", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0522c4c9-c6", "ovs_interfaceid": "0522c4c9-c604-4fca-859d-1eba394d7c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "address": "fa:16:3e:d6:74:8a", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbb8fb9-3c", "ovs_interfaceid": "acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "address": "fa:16:3e:00:bc:93", "network": {"id": "ced0378d-cf25-4645-981c-fb121542af56", "bridge": "br-int", "label": "tempest-device-tagging-net2-1576044543", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef290b352cc6495a86059ef9d86fa0ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d095b5-56", "ovs_interfaceid": "96d095b5-56cc-4d88-9e93-79cec1e314bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-461f8035-de57-4b68-81be-8b2e9b64901e req-301c051f-40b5-4b92-b51f-86376199eca8 service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Detach interface failed, port_id=dbf87b02-650f-4609-ae6b-bcef8a2eaa00, reason: Instance 6ad95b09-8a62-446b-b5cf-b42ff1093b41 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.neutron [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updated VIF entry in instance network info cache for port 9880ed69-8425-49aa-889d-ff0ad49562b3. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.neutron [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating instance_info_cache with network_info: [{"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a376fe6d-fe92-46c7-b2bb-0d9c3965df16 req-7e6c89e4-0bb7-4c39-b177-30c54e1ad386 service nova] Releasing lock "refresh_cache-2db4ebfb-3ff8-442e-b971-0a3d37861715" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Instance destroyed successfully.
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'resources' on Instance uuid 2db4ebfb-3ff8-442e-b971-0a3d37861715 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-974110021',display_name='tempest-TestStampPattern-server-974110021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-974110021',id=18,image_ref='096512a4-1099-4229-ae77-83704ce37762',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:53:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-vqu0j70h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='734cab0d-b6c6-4a43-95fa-cdd885639464',image_min_disk='1',image_min_ram='0',image_owner_id='d8fbc92865504ccf9f8f83c3b530227d',image_owner_project_name='tempest-TestStampPattern-899029107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-899029107-project-member',image_user_id='a1673b4507d547f0b1286d8f0a56f3b3',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:53:09Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=2db4ebfb-3ff8-442e-b971-0a3d37861715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "9880ed69-8425-49aa-889d-ff0ad49562b3", "address": "fa:16:3e:10:a7:c4", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9880ed69-84", "ovs_interfaceid": "9880ed69-8425-49aa-889d-ff0ad49562b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG os_vif [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9880ed69-84, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7fdb0d1-bb8d-4077-908a-e48655811bed) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:09 user nova-compute[74507]: INFO os_vif [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:a7:c4,bridge_name='br-int',has_traffic_filtering=True,id=9880ed69-8425-49aa-889d-ff0ad49562b3,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9880ed69-84')
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Deleting instance files /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715_del
Oct 25 22:56:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Deletion of /opt/stack/data/nova/instances/2db4ebfb-3ff8-442e-b971-0a3d37861715_del complete
Oct 25 22:56:10 user nova-compute[74507]: INFO nova.compute.manager [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:10 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Took 0.54 seconds to deallocate network for instance.
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-unplugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] No waiting events found dispatching network-vif-unplugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-unplugged-9880ed69-8425-49aa-889d-ff0ad49562b3 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Acquiring lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] No waiting events found dispatching network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:10 user nova-compute[74507]: WARNING nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received unexpected event network-vif-plugged-9880ed69-8425-49aa-889d-ff0ad49562b3 for instance with vm_state active and task_state deleting.
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-abf80a94-ac7c-45c2-9453-a7e55a1cac1d req-d2ac410f-f670-4812-a1c2-a8ef3261be11 service nova] [instance: 2db4ebfb-3ff8-442e-b971-0a3d37861715] Received event network-vif-deleted-9880ed69-8425-49aa-889d-ff0ad49562b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:10 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:11 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Deleted allocations for instance 2db4ebfb-3ff8-442e-b971-0a3d37861715
Oct 25 22:56:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-97557893-947b-4679-820c-cf0686b64ff7 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "2db4ebfb-3ff8-442e-b971-0a3d37861715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:11 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Took 3.83 seconds to deallocate network for instance.
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-86a3f032-2ee1-4335-b8e8-c8950fed796e req-2089afb8-53c2-4d7e-a485-88c9e0ed027f service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-deleted-acbb8fb9-3c69-4f06-a89e-33b3e6ac0ab5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-86a3f032-2ee1-4335-b8e8-c8950fed796e req-2089afb8-53c2-4d7e-a485-88c9e0ed027f service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-deleted-3b853a11-eadd-472c-b5f3-79762da19260 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-86a3f032-2ee1-4335-b8e8-c8950fed796e req-2089afb8-53c2-4d7e-a485-88c9e0ed027f service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-deleted-96d095b5-56cc-4d88-9e93-79cec1e314bc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-86a3f032-2ee1-4335-b8e8-c8950fed796e req-2089afb8-53c2-4d7e-a485-88c9e0ed027f service nova] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Received event network-vif-deleted-0522c4c9-c604-4fca-859d-1eba394d7c5a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:14 user nova-compute[74507]: INFO nova.compute.manager [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] [instance: 6ad95b09-8a62-446b-b5cf-b42ff1093b41] Took 2.87 seconds to detach 3 volumes for instance.
Oct 25 22:56:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:14 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:14 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:14 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Deleted allocations for instance 6ad95b09-8a62-446b-b5cf-b42ff1093b41
Oct 25 22:56:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-41ad25af-1ca2-4ef9-b5f8-d9ef0cbbf278 tempest-TaggedBootDevicesTest_v242-957934138 tempest-TaggedBootDevicesTest_v242-957934138-project-member] Lock "6ad95b09-8a62-446b-b5cf-b42ff1093b41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.816s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:29 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:56:30 user nova-compute[74507]: INFO nova.compute.claims [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Claim successful on node user
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:56:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:56:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.policy [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b81defc8e43843d3b14cc249f9e7dd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf59e935fe4170b38670efe09764dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:56:31 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Creating image(s)
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk 1073741824" returned: 0 in 0.053s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Successfully created port: 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Cannot resize image /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Ensure instance console log exists: /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Successfully updated port: 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing instance network info cache due to event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance network_info: |[{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start _get_guest_xml network_info=[{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:56:32 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:32 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0hiv9yMtDjZTMkufqi5csgWB0Phha38jJy5AW02qg2ZcXsPpjrurEkOngOSvnqQIhBjDpyYu+yzfVk3U+a0xnzMyVB+K5J14IXj3RByqmPJtdMhnilfmU4yluKgF/zSg==',key_name='tempest-keypair-383944364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_devices' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:56:32 user nova-compute[74507]:   <uuid>c59e7e75-ee1c-4751-8ef2-b46f80c9d907</uuid>
Oct 25 22:56:32 user nova-compute[74507]:   <name>instance-00000016</name>
Oct 25 22:56:32 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:56:32 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:56:32 user nova-compute[74507]:   <metadata>
Oct 25 22:56:32 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:56:32 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1689378523</nova:name>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:56:32</nova:creationTime>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:56:32 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:56:32 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:owner>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:user uuid="b81defc8e43843d3b14cc249f9e7dd73">tempest-AttachVolumeShelveTestJSON-2059391716-project-member</nova:user>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:project uuid="efbf59e935fe4170b38670efe09764dc">tempest-AttachVolumeShelveTestJSON-2059391716</nova:project>
Oct 25 22:56:32 user nova-compute[74507]:       </nova:owner>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:56:32 user nova-compute[74507]:       <nova:ports>
Oct 25 22:56:32 user nova-compute[74507]:         <nova:port uuid="9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5">
Oct 25 22:56:32 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 22:56:32 user nova-compute[74507]:         </nova:port>
Oct 25 22:56:32 user nova-compute[74507]:       </nova:ports>
Oct 25 22:56:32 user nova-compute[74507]:     </nova:instance>
Oct 25 22:56:32 user nova-compute[74507]:   </metadata>
Oct 25 22:56:32 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:56:32 user nova-compute[74507]:     <system>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="serial">c59e7e75-ee1c-4751-8ef2-b46f80c9d907</entry>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="uuid">c59e7e75-ee1c-4751-8ef2-b46f80c9d907</entry>
Oct 25 22:56:32 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:56:32 user nova-compute[74507]:     </system>
Oct 25 22:56:32 user nova-compute[74507]:   </sysinfo>
Oct 25 22:56:32 user nova-compute[74507]:   <os>
Oct 25 22:56:32 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:56:32 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:56:32 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:56:32 user nova-compute[74507]:   </os>
Oct 25 22:56:32 user nova-compute[74507]:   <features>
Oct 25 22:56:32 user nova-compute[74507]:     <acpi/>
Oct 25 22:56:32 user nova-compute[74507]:     <apic/>
Oct 25 22:56:32 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:56:32 user nova-compute[74507]:   </features>
Oct 25 22:56:32 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:56:32 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:56:32 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:56:32 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:56:32 user nova-compute[74507]:   </clock>
Oct 25 22:56:32 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:56:32 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:56:32 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:56:32 user nova-compute[74507]:   </cpu>
Oct 25 22:56:32 user nova-compute[74507]:   <devices>
Oct 25 22:56:32 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:56:32 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:56:32 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk"/>
Oct 25 22:56:32 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:56:32 user nova-compute[74507]:     </disk>
Oct 25 22:56:32 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:56:32 user nova-compute[74507]:       <mac address="fa:16:3e:21:93:f4"/>
Oct 25 22:56:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:56:32 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:56:32 user nova-compute[74507]:       <target dev="tap9cb8c7f9-45"/>
Oct 25 22:56:32 user nova-compute[74507]:     </interface>
Oct 25 22:56:32 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:56:32 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/console.log" append="off"/>
Oct 25 22:56:32 user nova-compute[74507]:     </serial>
Oct 25 22:56:32 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:56:32 user nova-compute[74507]:     <video>
Oct 25 22:56:32 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:56:32 user nova-compute[74507]:     </video>
Oct 25 22:56:32 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:56:32 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:56:32 user nova-compute[74507]:     </rng>
Oct 25 22:56:32 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:56:32 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:56:32 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:56:32 user nova-compute[74507]:     </memballoon>
Oct 25 22:56:32 user nova-compute[74507]:   </devices>
Oct 25 22:56:32 user nova-compute[74507]: </domain>
Oct 25 22:56:32 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0hiv9yMtDjZTMkufqi5csgWB0Phha38jJy5AW02qg2ZcXsPpjrurEkOngOSvnqQIhBjDpyYu+yzfVk3U+a0xnzMyVB+K5J14IXj3RByqmPJtdMhnilfmU4yluKgF/zSg==',key_name='tempest-keypair-383944364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:56:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_vif [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '058ea52b-acb4-52b5-88cb-aec6ea1c6ea2', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cb8c7f9-45, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cb8c7f9-45, col_values=(('qos', UUID('ce6eee19-a848-4c92-b157-e532151e9f12')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cb8c7f9-45, col_values=(('external_ids', {'iface-id': '9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:93:f4', 'vm-uuid': 'c59e7e75-ee1c-4751-8ef2-b46f80c9d907'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:32 user nova-compute[74507]: INFO os_vif [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45')
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJusDfpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:56:32 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:56:32 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:56:32 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713a5b3-3e4a-431a-baaf-d5b522ef84af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:56:32 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No VIF found with MAC fa:16:3e:21:93:f4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb36216-fa74-47c2-b101-de1051a09ffa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04] added
Oct 25 22:56:32 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[91050917-a284-49e5-a0fc-9fa7087bea14]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a483904-3971-4bcd-8edc-ff1ab1b18251]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJusDfpA {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJusDfpA" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5ee81-0e1c-4044-a329-6e72741297f0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJusDfpA'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea3c3fc-03de-4471-8773-f92cd0f78b33]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4049b-6749-4173-bc55-3764d19be502]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:56:33 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 22:56:33 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:56:33 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 22:56:33 user nova-compute[74507]: 
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25faa27f-3b77-4f86-88a8-8b0de263406a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260]
Oct 25 22:56:33 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260] successful.
Oct 25 22:56:33 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3467c8e-7c06-4a25-9d8a-ca267333271f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22cb560-9990-4604-939a-fb885b13537e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:56:33 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:56:33 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updated VIF entry in instance network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe64a8-d494-4d56-906e-1464679fa8a8]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJusDfpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-29a34003-09dd-42e2-9dcd-fb928b44d3df req-ad9dd5a1-c224-4923-a2bb-5d30e052d527 service nova] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23238353162363761', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238353162363761', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'flavor' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:56:34 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:56:34 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 22:56:34 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:56:34 user nova-compute[74507]:   <serial>bc058bf1-3035-4490-80b9-c6c8313c6c04</serial>
Oct 25 22:56:34 user nova-compute[74507]: </disk>
Oct 25 22:56:34 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:34 user nova-compute[74507]: WARNING nova.compute.manager [req-4922532b-1617-4ef1-bde0-fdc05ff04be0 req-3c3f28f4-ff10-458f-b001-5c56a93e02c9 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state building and task_state spawning.
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:56:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:d8:5f:c8, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1db29a80-4584-4765-a1a1-713fba5fddb9 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.875s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:36 user nova-compute[74507]: INFO nova.compute.manager [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Rescuing
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:36 user nova-compute[74507]: WARNING nova.compute.manager [req-b783032b-e19c-4112-80a9-d6399a0e61b3 req-235c70a6-8a35-46bf-82b0-2561a391d475 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state building and task_state spawning.
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:56:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance spawned successfully.
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: INFO nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Took 5.99 seconds to spawn the instance on the hypervisor.
Oct 25 22:56:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:37 user nova-compute[74507]: INFO nova.compute.manager [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Took 6.71 seconds to build instance.
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2abe37c1-753c-4cd5-85d4-ed49ecd41f74 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.856s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance destroyed successfully.
Oct 25 22:56:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Attempting rescue
Oct 25 22:56:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 22:56:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Creating image(s)
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.223s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue" returned: 0 in 0.052s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'migration_context' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.base [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start _get_guest_xml network_info=[{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:d8:5f:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.base [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.base [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.base [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1958550715',display_name='tempest-ServerRescueNegativeTestJSON-server-1958550715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1958550715',id=21,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIY85996ZqLbqvshNzZSsujgnp/ztI7GN/hGUjYO3U8dGZLWF3nCBiUPa3CVpbxDKtdqHED8YGvMJvNmTJjKFztx7lAeaOksc5O+gpQy8hYynSJ3Yr6OFji5b7rKkM//A==',key_name='tempest-keypair-855081839',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-xwfxqu5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4427778755994cca9d47b515e4aed8ea',uuid=2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:d8:5f:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "vif_mac": "fa:16:3e:d8:5f:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.objects.base [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Object Instance<2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:56:38 user nova-compute[74507]:   <uuid>2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</uuid>
Oct 25 22:56:38 user nova-compute[74507]:   <name>instance-00000015</name>
Oct 25 22:56:38 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:56:38 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:56:38 user nova-compute[74507]:   <metadata>
Oct 25 22:56:38 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:56:38 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1958550715</nova:name>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:56:38</nova:creationTime>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:56:38 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:56:38 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:owner>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:user uuid="4427778755994cca9d47b515e4aed8ea">tempest-ServerRescueNegativeTestJSON-583210992-project-member</nova:user>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:project uuid="70aab19396a0456fbe1e2dc9a8829bcb">tempest-ServerRescueNegativeTestJSON-583210992</nova:project>
Oct 25 22:56:38 user nova-compute[74507]:       </nova:owner>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:56:38 user nova-compute[74507]:       <nova:ports>
Oct 25 22:56:38 user nova-compute[74507]:         <nova:port uuid="cf6f3743-2f78-43f1-871c-e88929de8281">
Oct 25 22:56:38 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 22:56:38 user nova-compute[74507]:         </nova:port>
Oct 25 22:56:38 user nova-compute[74507]:       </nova:ports>
Oct 25 22:56:38 user nova-compute[74507]:     </nova:instance>
Oct 25 22:56:38 user nova-compute[74507]:   </metadata>
Oct 25 22:56:38 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:56:38 user nova-compute[74507]:     <system>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="serial">2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</entry>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="uuid">2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e</entry>
Oct 25 22:56:38 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:56:38 user nova-compute[74507]:     </system>
Oct 25 22:56:38 user nova-compute[74507]:   </sysinfo>
Oct 25 22:56:38 user nova-compute[74507]:   <os>
Oct 25 22:56:38 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:56:38 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:56:38 user nova-compute[74507]:   </os>
Oct 25 22:56:38 user nova-compute[74507]:   <features>
Oct 25 22:56:38 user nova-compute[74507]:     <acpi/>
Oct 25 22:56:38 user nova-compute[74507]:     <apic/>
Oct 25 22:56:38 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:56:38 user nova-compute[74507]:   </features>
Oct 25 22:56:38 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:56:38 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:56:38 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:56:38 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:56:38 user nova-compute[74507]:   </clock>
Oct 25 22:56:38 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:56:38 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:56:38 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:56:38 user nova-compute[74507]:   </cpu>
Oct 25 22:56:38 user nova-compute[74507]:   <devices>
Oct 25 22:56:38 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:56:38 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:56:38 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue"/>
Oct 25 22:56:38 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:56:38 user nova-compute[74507]:     </disk>
Oct 25 22:56:38 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:56:38 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:56:38 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk"/>
Oct 25 22:56:38 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:56:38 user nova-compute[74507]:     </disk>
Oct 25 22:56:38 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:56:38 user nova-compute[74507]:       <mac address="fa:16:3e:d8:5f:c8"/>
Oct 25 22:56:38 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:56:38 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:56:38 user nova-compute[74507]:       <target dev="tapcf6f3743-2f"/>
Oct 25 22:56:38 user nova-compute[74507]:     </interface>
Oct 25 22:56:38 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:56:38 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/console.log" append="off"/>
Oct 25 22:56:38 user nova-compute[74507]:     </serial>
Oct 25 22:56:38 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:56:38 user nova-compute[74507]:     <video>
Oct 25 22:56:38 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:56:38 user nova-compute[74507]:     </video>
Oct 25 22:56:38 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:56:38 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:56:38 user nova-compute[74507]:     </rng>
Oct 25 22:56:38 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:56:38 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:56:38 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:56:38 user nova-compute[74507]:     </memballoon>
Oct 25 22:56:38 user nova-compute[74507]:   </devices>
Oct 25 22:56:38 user nova-compute[74507]: </domain>
Oct 25 22:56:38 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:56:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance destroyed successfully.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] No VIF found with MAC fa:16:3e:d8:5f:c8, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:38 user nova-compute[74507]: WARNING nova.compute.manager [req-7bacb405-eca1-41da-880a-daa26a51685d req-c5ee8633-54e2-4c1e-9b95-9cf861066bc9 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:40 user nova-compute[74507]: WARNING nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:40 user nova-compute[74507]: WARNING nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:56:40 user nova-compute[74507]: WARNING nova.compute.manager [req-206564d9-b2ee-4542-9317-6b900144ab8f req-a3b095cf-78eb-4db4-9593-4ece93da7e6b service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state active and task_state rescuing.
Oct 25 22:56:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:56:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-0e65bd96-5538-455f-9fb2-5002d84845e7 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:56:42 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:42 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=25.077022552490234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 734cab0d-b6c6-4a43-95fa-cdd885639464 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 22:56:42 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.813s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 22:56:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 22:56:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:56:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:56:53 user nova-compute[74507]: INFO nova.compute.claims [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Claim successful on node user
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:56:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:56:53 user nova-compute[74507]: INFO nova.virt.block_device [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Booting with blank volume at /dev/vda
Oct 25 22:56:53 user nova-compute[74507]: DEBUG nova.policy [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4da245cae18d400ab7b8c787bfd10156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdf2550d504422686b0a2a829758690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:56:54 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Successfully created port: e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Successfully updated port: e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-changed-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Refreshing instance network info cache due to event network-changed-e304d3b5-349e-4908-a1c6-bb3ed2d92698. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance network_info: |[{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Refreshing network info cache for port e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updated VIF entry in instance network info cache for port e304d3b5-349e-4908-a1c6-bb3ed2d92698. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG nova.network.neutron [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:56:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-128e036b-1d1f-4bb9-8783-605226a33bc4 req-c6346221-1f2d-418d-954f-cec97abfcef4 service nova] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:56:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:56:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:00 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:57:00 user nova-compute[74507]: INFO nova.compute.claims [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Claim successful on node user
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:57:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.policy [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62ab99f645064dacb32c07b5beae3f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a9cb2b4089144f4b19cd0a3cba46a8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:57:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Creating image(s)
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "/opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "/opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "/opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.269s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk 1073741824" returned: 0 in 0.057s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Successfully created port: f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.224s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Cannot resize image /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Ensure instance console log exists: /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Successfully updated port: f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquired lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-changed-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Refreshing instance network info cache due to event network-changed-f0102a28-943c-468a-95ee-b6d38224147e. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] Acquiring lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:57:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating instance_info_cache with network_info: [{"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Releasing lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Instance network_info: |[{"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] Acquired lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Refreshing network info cache for port f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Start _get_guest_xml network_info=[{"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:57:03 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:03 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-315354283',display_name='tempest-AttachVolumeTestJSON-server-315354283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-315354283',id=24,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7clR2Cu4h9TSLxy9KrXUNYwfXNDuD4cUBIZwgTiESVgTRKi4XjVIxiBZWi0C/u28rRQRqpEouxOrIhwVHREZolxj/gMLyokbvW6tG4wOZ4e9/WgSPFmGlNDoExI3h1gQ==',key_name='tempest-keypair-1575894462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-fe4xm9y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=95222a21-d30d-4541-ad93-2bf6ec9eb7f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'pci_devices' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:57:03 user nova-compute[74507]:   <uuid>95222a21-d30d-4541-ad93-2bf6ec9eb7f2</uuid>
Oct 25 22:57:03 user nova-compute[74507]:   <name>instance-00000018</name>
Oct 25 22:57:03 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:57:03 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:57:03 user nova-compute[74507]:   <metadata>
Oct 25 22:57:03 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:57:03 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeTestJSON-server-315354283</nova:name>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:57:03</nova:creationTime>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:57:03 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:57:03 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:owner>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:user uuid="62ab99f645064dacb32c07b5beae3f8f">tempest-AttachVolumeTestJSON-1587183484-project-member</nova:user>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:project uuid="0a9cb2b4089144f4b19cd0a3cba46a8e">tempest-AttachVolumeTestJSON-1587183484</nova:project>
Oct 25 22:57:03 user nova-compute[74507]:       </nova:owner>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:57:03 user nova-compute[74507]:       <nova:ports>
Oct 25 22:57:03 user nova-compute[74507]:         <nova:port uuid="f0102a28-943c-468a-95ee-b6d38224147e">
Oct 25 22:57:03 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 22:57:03 user nova-compute[74507]:         </nova:port>
Oct 25 22:57:03 user nova-compute[74507]:       </nova:ports>
Oct 25 22:57:03 user nova-compute[74507]:     </nova:instance>
Oct 25 22:57:03 user nova-compute[74507]:   </metadata>
Oct 25 22:57:03 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:57:03 user nova-compute[74507]:     <system>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="serial">95222a21-d30d-4541-ad93-2bf6ec9eb7f2</entry>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="uuid">95222a21-d30d-4541-ad93-2bf6ec9eb7f2</entry>
Oct 25 22:57:03 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:57:03 user nova-compute[74507]:     </system>
Oct 25 22:57:03 user nova-compute[74507]:   </sysinfo>
Oct 25 22:57:03 user nova-compute[74507]:   <os>
Oct 25 22:57:03 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:57:03 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:57:03 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:57:03 user nova-compute[74507]:   </os>
Oct 25 22:57:03 user nova-compute[74507]:   <features>
Oct 25 22:57:03 user nova-compute[74507]:     <acpi/>
Oct 25 22:57:03 user nova-compute[74507]:     <apic/>
Oct 25 22:57:03 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:57:03 user nova-compute[74507]:   </features>
Oct 25 22:57:03 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:57:03 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:57:03 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:57:03 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:57:03 user nova-compute[74507]:   </clock>
Oct 25 22:57:03 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:57:03 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:57:03 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:57:03 user nova-compute[74507]:   </cpu>
Oct 25 22:57:03 user nova-compute[74507]:   <devices>
Oct 25 22:57:03 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:57:03 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:57:03 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk"/>
Oct 25 22:57:03 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:57:03 user nova-compute[74507]:     </disk>
Oct 25 22:57:03 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:57:03 user nova-compute[74507]:       <mac address="fa:16:3e:e6:6e:89"/>
Oct 25 22:57:03 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:57:03 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:57:03 user nova-compute[74507]:       <target dev="tapf0102a28-94"/>
Oct 25 22:57:03 user nova-compute[74507]:     </interface>
Oct 25 22:57:03 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:57:03 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/console.log" append="off"/>
Oct 25 22:57:03 user nova-compute[74507]:     </serial>
Oct 25 22:57:03 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:57:03 user nova-compute[74507]:     <video>
Oct 25 22:57:03 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:57:03 user nova-compute[74507]:     </video>
Oct 25 22:57:03 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:57:03 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:57:03 user nova-compute[74507]:     </rng>
Oct 25 22:57:03 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:57:03 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:57:03 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:57:03 user nova-compute[74507]:     </memballoon>
Oct 25 22:57:03 user nova-compute[74507]:   </devices>
Oct 25 22:57:03 user nova-compute[74507]: </domain>
Oct 25 22:57:03 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-315354283',display_name='tempest-AttachVolumeTestJSON-server-315354283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-315354283',id=24,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7clR2Cu4h9TSLxy9KrXUNYwfXNDuD4cUBIZwgTiESVgTRKi4XjVIxiBZWi0C/u28rRQRqpEouxOrIhwVHREZolxj/gMLyokbvW6tG4wOZ4e9/WgSPFmGlNDoExI3h1gQ==',key_name='tempest-keypair-1575894462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-fe4xm9y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=95222a21-d30d-4541-ad93-2bf6ec9eb7f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG os_vif [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cae10e1d-5f8e-57cc-ade2-009b241c506d', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0102a28-94, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0102a28-94, col_values=(('qos', UUID('6852cc70-57ba-4b1a-9c78-eb4d695a5f83')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0102a28-94, col_values=(('external_ids', {'iface-id': 'f0102a28-943c-468a-95ee-b6d38224147e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:6e:89', 'vm-uuid': '95222a21-d30d-4541-ad93-2bf6ec9eb7f2'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:03 user nova-compute[74507]: INFO os_vif [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94')
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No VIF found with MAC fa:16:3e:e6:6e:89, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updated VIF entry in instance network info cache for port f0102a28-943c-468a-95ee-b6d38224147e. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating instance_info_cache with network_info: [{"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe7d2d8e-a1bd-4e49-89b9-2b193bbfdd43 req-500dde2c-d616-47b2-8bc5-7bc49c05656d service nova] Releasing lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.utils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4216c3d0-7fd4-4239-a4cd-918ff36e94ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a5346f-37d9-4f81-ad07-30c85f95f590]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c14e67d-7984-4d89-b21e-f45c0b342f21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20f26c1-d285-4c16-96f1-66a533746a57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:57:04 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:57:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e65fa-969a-48d8-a085-216518918c98]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG os_brick.utils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:57:04 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating existing volume attachment record: 4ff34a27-6664-4c30-8153-fc02217e700f {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] No waiting events found dispatching network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:05 user nova-compute[74507]: WARNING nova.compute.manager [req-24f2088e-3495-446f-89db-83fdff80e6b1 req-bfe609c8-3712-4c77-afdf-e4a5b8462448 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received unexpected event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e for instance with vm_state building and task_state spawning.
Oct 25 22:57:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:57:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:57:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Instance spawned successfully.
Oct 25 22:57:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:07 user nova-compute[74507]: INFO nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:57:07 user nova-compute[74507]: INFO nova.compute.manager [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Took 6.54 seconds to build instance.
Oct 25 22:57:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f34221e-3949-4ea5-bd26-f7cc962d471e tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.662s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] No waiting events found dispatching network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:07 user nova-compute[74507]: WARNING nova.compute.manager [req-67be564c-7f27-4127-951b-1fc7e3ced4a8 req-9353ccd2-e5ce-43bc-b6d1-e0679117e4e8 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received unexpected event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e for instance with vm_state active and task_state None.
Oct 25 22:57:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing instance network info cache due to event network-changed-e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] Acquiring lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] Acquired lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Refreshing network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:21 user nova-compute[74507]: INFO nova.compute.manager [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Terminating instance
Oct 25 22:57:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updated VIF entry in instance network info cache for port e33e95f6-07ba-4d59-acc3-c542e36653fa. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [{"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c97685fd-c85e-4fb7-99eb-bdf649e33ccd req-c3285aac-5ef5-4206-b860-c71c5c8dd1bc service nova] Releasing lock "refresh_cache-734cab0d-b6c6-4a43-95fa-cdd885639464" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Instance destroyed successfully.
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lazy-loading 'resources' on Instance uuid 734cab0d-b6c6-4a43-95fa-cdd885639464 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:49:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-395427938',display_name='tempest-TestStampPattern-server-395427938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-395427938',id=12,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1oE6uKbQAW2g1Zavf2ejGj49YrigoIcac0zSbzF0ExkbUwWkE6W030vj0S+gENbE6DicvJ40S9yBY84vq7gPCL6T3t+1YbwSC9sP3XI9PuyJJOmViGxpC4jMXXvb4y7Q==',key_name='tempest-TestStampPattern-1802832802',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:49:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8fbc92865504ccf9f8f83c3b530227d',ramdisk_id='',reservation_id='r-1qz0u95s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-899029107',owner_user_name='tempest-TestStampPattern-899029107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:58Z,user_data=None,user_id='a1673b4507d547f0b1286d8f0a56f3b3',uuid=734cab0d-b6c6-4a43-95fa-cdd885639464,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converting VIF {"id": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "address": "fa:16:3e:76:95:b6", "network": {"id": "d40b1e7f-2c50-4c6a-923d-17a6d5031a23", "bridge": "br-int", "label": "tempest-TestStampPattern-1516535560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8fbc92865504ccf9f8f83c3b530227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape33e95f6-07", "ovs_interfaceid": "e33e95f6-07ba-4d59-acc3-c542e36653fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG os_vif [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape33e95f6-07, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dfd4777-6355-4e86-b9ee-d0a59b6ecb47) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:22 user nova-compute[74507]: INFO os_vif [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:95:b6,bridge_name='br-int',has_traffic_filtering=True,id=e33e95f6-07ba-4d59-acc3-c542e36653fa,network=Network(d40b1e7f-2c50-4c6a-923d-17a6d5031a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape33e95f6-07')
Oct 25 22:57:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Deleting instance files /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464_del
Oct 25 22:57:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Deletion of /opt/stack/data/nova/instances/734cab0d-b6c6-4a43-95fa-cdd885639464_del complete
Oct 25 22:57:22 user nova-compute[74507]: INFO nova.compute.manager [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 25 22:57:22 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:57:22 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:23 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Took 0.55 seconds to deallocate network for instance.
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:57:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Creating image(s)
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Ensure instance console log exists: /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start _get_guest_xml network_info=[{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4ff34a27-6664-4c30-8153-fc02217e700f', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b5116dc-7dd3-414b-89d6-9c318a41a63f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'serial': 'c648b3e0-bbc4-4f43-ae33-78b1ed95fede'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:57:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:57:23 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:57:23 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:57:23 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5bf9a-684d-4745-8baa-e939e72ec4a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:57:23 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f5cda-12d8-40a6-b7c7-081d8da564b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede] added
Oct 25 22:57:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c737e839-2966-44da-b4d3-caf0e8636df5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763d62e-7cb6-41b6-845b-e5371cf6b4d1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVFkNHid {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVFkNHid" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834c0bd-abd6-4141-ac93-8503effc1dd6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVFkNHid'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-vif-unplugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] No waiting events found dispatching network-vif-unplugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:23 user nova-compute[74507]: WARNING nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received unexpected event network-vif-unplugged-e33e95f6-07ba-4d59-acc3-c542e36653fa for instance with vm_state deleted and task_state None.
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Acquiring lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] No waiting events found dispatching network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:23 user nova-compute[74507]: WARNING nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received unexpected event network-vif-plugged-e33e95f6-07ba-4d59-acc3-c542e36653fa for instance with vm_state deleted and task_state None.
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ee0d94-cc39-418f-970c-e067d2b7d97f req-245ed9a1-5477-4354-9741-fd3eeb5af8ff service nova] [instance: 734cab0d-b6c6-4a43-95fa-cdd885639464] Received event network-vif-deleted-e33e95f6-07ba-4d59-acc3-c542e36653fa {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d03afbb-1f6d-41f1-9597-1a21a83b2d08]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb24bf94-e54d-4500-8905-bec805fb9bda]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:57:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:57:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[339bcfb7-e9f9-41cf-89e1-dac6b9b43dae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260]
Oct 25 22:57:24 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260] successful.
Oct 25 22:57:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:24 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Deleted allocations for instance 734cab0d-b6c6-4a43-95fa-cdd885639464
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f2dd73-a13a-489f-bba5-bbb5c7384e72]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ebc42-bec7-4071-b320-04ae41908f6d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:57:24 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:57:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:57:24 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:57:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b7785-4dc7-4109-9c51-b25e253a0f19]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:57:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f77e7b8e-fbd8-4f44-b3d9-e8d04aaa4de4 tempest-TestStampPattern-899029107 tempest-TestStampPattern-899029107-project-member] Lock "734cab0d-b6c6-4a43-95fa-cdd885639464" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26630633563383938', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633563383938', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-784031805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-784031805',id=23,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-67n5t0ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:56:54Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=2b5116dc-7dd3-414b-89d6-9c318a41a63f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.objects.instance [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:57:25 user nova-compute[74507]:   <uuid>2b5116dc-7dd3-414b-89d6-9c318a41a63f</uuid>
Oct 25 22:57:25 user nova-compute[74507]:   <name>instance-00000017</name>
Oct 25 22:57:25 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:57:25 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:57:25 user nova-compute[74507]:   <metadata>
Oct 25 22:57:25 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:57:25 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-784031805</nova:name>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:57:23</nova:creationTime>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:57:25 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:57:25 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:owner>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 22:57:25 user nova-compute[74507]:       </nova:owner>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:57:25 user nova-compute[74507]:       <nova:ports>
Oct 25 22:57:25 user nova-compute[74507]:         <nova:port uuid="e304d3b5-349e-4908-a1c6-bb3ed2d92698">
Oct 25 22:57:25 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:57:25 user nova-compute[74507]:         </nova:port>
Oct 25 22:57:25 user nova-compute[74507]:       </nova:ports>
Oct 25 22:57:25 user nova-compute[74507]:     </nova:instance>
Oct 25 22:57:25 user nova-compute[74507]:   </metadata>
Oct 25 22:57:25 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:57:25 user nova-compute[74507]:     <system>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="serial">2b5116dc-7dd3-414b-89d6-9c318a41a63f</entry>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="uuid">2b5116dc-7dd3-414b-89d6-9c318a41a63f</entry>
Oct 25 22:57:25 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:57:25 user nova-compute[74507]:     </system>
Oct 25 22:57:25 user nova-compute[74507]:   </sysinfo>
Oct 25 22:57:25 user nova-compute[74507]:   <os>
Oct 25 22:57:25 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:57:25 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:57:25 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:57:25 user nova-compute[74507]:   </os>
Oct 25 22:57:25 user nova-compute[74507]:   <features>
Oct 25 22:57:25 user nova-compute[74507]:     <acpi/>
Oct 25 22:57:25 user nova-compute[74507]:     <apic/>
Oct 25 22:57:25 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:57:25 user nova-compute[74507]:   </features>
Oct 25 22:57:25 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:57:25 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:57:25 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:57:25 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:57:25 user nova-compute[74507]:   </clock>
Oct 25 22:57:25 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:57:25 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:57:25 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:57:25 user nova-compute[74507]:   </cpu>
Oct 25 22:57:25 user nova-compute[74507]:   <devices>
Oct 25 22:57:25 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:57:25 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:57:25 user nova-compute[74507]:       <source dev="/dev/sdc"/>
Oct 25 22:57:25 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:57:25 user nova-compute[74507]:       <serial>c648b3e0-bbc4-4f43-ae33-78b1ed95fede</serial>
Oct 25 22:57:25 user nova-compute[74507]:     </disk>
Oct 25 22:57:25 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:57:25 user nova-compute[74507]:       <mac address="fa:16:3e:bc:0e:c9"/>
Oct 25 22:57:25 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:57:25 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:57:25 user nova-compute[74507]:       <target dev="tape304d3b5-34"/>
Oct 25 22:57:25 user nova-compute[74507]:     </interface>
Oct 25 22:57:25 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:57:25 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/console.log" append="off"/>
Oct 25 22:57:25 user nova-compute[74507]:     </serial>
Oct 25 22:57:25 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:57:25 user nova-compute[74507]:     <video>
Oct 25 22:57:25 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:57:25 user nova-compute[74507]:     </video>
Oct 25 22:57:25 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:57:25 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:57:25 user nova-compute[74507]:     </rng>
Oct 25 22:57:25 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:57:25 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:57:25 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:57:25 user nova-compute[74507]:     </memballoon>
Oct 25 22:57:25 user nova-compute[74507]:   </devices>
Oct 25 22:57:25 user nova-compute[74507]: </domain>
Oct 25 22:57:25 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-784031805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-784031805',id=23,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-67n5t0ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:56:54Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=2b5116dc-7dd3-414b-89d6-9c318a41a63f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG os_vif [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f44e558d-97f3-5d8e-8830-acfec3f0e213', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape304d3b5-34, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape304d3b5-34, col_values=(('qos', UUID('832a1632-575b-47cc-a272-f39b9fe74eb1')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape304d3b5-34, col_values=(('external_ids', {'iface-id': 'e304d3b5-349e-4908-a1c6-bb3ed2d92698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:0e:c9', 'vm-uuid': '2b5116dc-7dd3-414b-89d6-9c318a41a63f'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:25 user nova-compute[74507]: INFO os_vif [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34')
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:57:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:bc:0e:c9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:26 user nova-compute[74507]: WARNING nova.compute.manager [req-da9f3555-171e-42bb-8a4c-e3a7b283a87a req-e219d0b9-e267-40fc-94a9-e09884936930 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state building and task_state spawning.
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:57:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance spawned successfully.
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:57:28 user nova-compute[74507]: INFO nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Took 5.18 seconds to spawn the instance on the hypervisor.
Oct 25 22:57:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:57:28 user nova-compute[74507]: INFO nova.compute.manager [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Took 35.78 seconds to build instance.
Oct 25 22:57:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bccbea6e-72c0-423d-a8d1-fff4caa8d2e3 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.882s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:57:29 user nova-compute[74507]: WARNING nova.compute.manager [req-551716b2-d3f7-4616-98eb-681ecfb8539c req-655a7828-776e-499d-ad89-af0c49a5d55e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state active and task_state None.
Oct 25 22:57:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:32 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:57:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:57:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [{"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-cee2d99c-cce8-419f-91da-6523af9313de" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:57:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:57:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:57:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.131988525390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance cee2d99c-cce8-419f-91da-6523af9313de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:57:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:57:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:57:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:57:46 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:57:46 user nova-compute[74507]: INFO nova.compute.claims [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Claim successful on node user
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:57:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:57:47 user nova-compute[74507]: INFO nova.virt.block_device [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Booting with volume 87bbdff7-6227-498c-ae83-880aa183b685 at /dev/vda
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.policy [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40a2834cde90449e8067ae627d799836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bae88be410b4835bd2e0470ed90a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.utils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0ca7e-14ba-49f6-bdab-f32ce7b8340c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.235s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f71b3-036b-4d3d-aa2f-5a55ced1e72d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be406d-a96e-4b99-b439-95e1c800a42f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf1ce0-699d-4200-a53c-7d872e9eb9e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:57:47 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:57:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1308569c-bdd5-45af-993b-852b371afb53]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG os_brick.utils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== get_connector_properties: return (377ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:57:47 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating existing volume attachment record: 8d06b333-d3c7-4d52-9a6a-0650c3c81042 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:57:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Successfully created port: c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Successfully updated port: c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-changed-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Refreshing instance network info cache due to event network-changed-c26964ed-5bb7-4522-9569-b08e7b085ca9. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance network_info: |[{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:57:49 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Refreshing network info cache for port c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:57:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:57:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updated VIF entry in instance network info cache for port c26964ed-5bb7-4522-9569-b08e7b085ca9. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:57:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:57:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a71fef7-b12c-45e0-9d2f-dbd99db5f2cb req-855d5f2a-c753-4f83-b4a4-c7065780bb38 service nova] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:57:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:58:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:58:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Creating image(s)
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start _get_guest_xml network_info=[{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d06b333-d3c7-4d52-9a6a-0650c3c81042', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e', 'attached_at': '', 'detached_at': '', 'volume_id': '87bbdff7-6227-498c-ae83-880aa183b685', 'serial': '87bbdff7-6227-498c-ae83-880aa183b685'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:58:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:58:11 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:58:11 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:58:11 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ed954-8df0-4ca6-b6cd-e3bbb4fa665c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:58:11 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[461928a6-ac5f-4431-bcc5-f427e9ced18c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685] added
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f6c3b-17b9-4453-86ab-f1c0fa81a887]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55d7e2a-b58f-43fa-a937-30fb54bd998b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ieMhxYmQ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ieMhxYmQ" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4868d0-bb1c-4a7b-87e4-860d0ac9be6b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ieMhxYmQ'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[906cda41-6179-4226-89b5-b989532ec38a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e815914-fb9f-4da6-81d7-2a52b894cf62]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd3843-d6ed-443d-a75f-006263a3afdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]
Oct 25 22:58:11 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8be2af-7f18-46c7-94ef-5e775af07d3c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f81e02-3edc-43e2-9884-00bae2a838d2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:11 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:58:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6d756-5fe4-47a0-830c-3ce1910734e5]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:58:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23066326238626636', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066326238626636', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'pci_devices' on Instance uuid af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:58:12 user nova-compute[74507]:   <uuid>af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</uuid>
Oct 25 22:58:12 user nova-compute[74507]:   <name>instance-00000019</name>
Oct 25 22:58:12 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:58:12 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:58:12 user nova-compute[74507]:   <metadata>
Oct 25 22:58:12 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:58:12 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:58:12 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherA-server-1903179898</nova:name>
Oct 25 22:58:12 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:58:11</nova:creationTime>
Oct 25 22:58:12 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:58:12 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:58:12 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:58:12 user nova-compute[74507]:       <nova:owner>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:user uuid="40a2834cde90449e8067ae627d799836">tempest-ServerActionsTestOtherA-1402899626-project-member</nova:user>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:project uuid="0bae88be410b4835bd2e0470ed90a895">tempest-ServerActionsTestOtherA-1402899626</nova:project>
Oct 25 22:58:12 user nova-compute[74507]:       </nova:owner>
Oct 25 22:58:12 user nova-compute[74507]:       <nova:ports>
Oct 25 22:58:12 user nova-compute[74507]:         <nova:port uuid="c26964ed-5bb7-4522-9569-b08e7b085ca9">
Oct 25 22:58:12 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 22:58:12 user nova-compute[74507]:         </nova:port>
Oct 25 22:58:12 user nova-compute[74507]:       </nova:ports>
Oct 25 22:58:12 user nova-compute[74507]:     </nova:instance>
Oct 25 22:58:12 user nova-compute[74507]:   </metadata>
Oct 25 22:58:12 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:58:12 user nova-compute[74507]:     <system>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="serial">af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</entry>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="uuid">af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</entry>
Oct 25 22:58:12 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:58:12 user nova-compute[74507]:     </system>
Oct 25 22:58:12 user nova-compute[74507]:   </sysinfo>
Oct 25 22:58:12 user nova-compute[74507]:   <os>
Oct 25 22:58:12 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:58:12 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:58:12 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:58:12 user nova-compute[74507]:   </os>
Oct 25 22:58:12 user nova-compute[74507]:   <features>
Oct 25 22:58:12 user nova-compute[74507]:     <acpi/>
Oct 25 22:58:12 user nova-compute[74507]:     <apic/>
Oct 25 22:58:12 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:58:12 user nova-compute[74507]:   </features>
Oct 25 22:58:12 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:58:12 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:58:12 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:58:12 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:58:12 user nova-compute[74507]:   </clock>
Oct 25 22:58:12 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:58:12 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:58:12 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:58:12 user nova-compute[74507]:   </cpu>
Oct 25 22:58:12 user nova-compute[74507]:   <devices>
Oct 25 22:58:12 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:58:12 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:58:12 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 22:58:12 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:58:12 user nova-compute[74507]:       <serial>87bbdff7-6227-498c-ae83-880aa183b685</serial>
Oct 25 22:58:12 user nova-compute[74507]:     </disk>
Oct 25 22:58:12 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:58:12 user nova-compute[74507]:       <mac address="fa:16:3e:1b:16:e5"/>
Oct 25 22:58:12 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:12 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:58:12 user nova-compute[74507]:       <target dev="tapc26964ed-5b"/>
Oct 25 22:58:12 user nova-compute[74507]:     </interface>
Oct 25 22:58:12 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:58:12 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e/console.log" append="off"/>
Oct 25 22:58:12 user nova-compute[74507]:     </serial>
Oct 25 22:58:12 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:58:12 user nova-compute[74507]:     <video>
Oct 25 22:58:12 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:12 user nova-compute[74507]:     </video>
Oct 25 22:58:12 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:58:12 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:58:12 user nova-compute[74507]:     </rng>
Oct 25 22:58:12 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:58:12 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:58:12 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:58:12 user nova-compute[74507]:     </memballoon>
Oct 25 22:58:12 user nova-compute[74507]:   </devices>
Oct 25 22:58:12 user nova-compute[74507]: </domain>
Oct 25 22:58:12 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG os_vif [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7df75d95-2244-5bbf-9a52-4e8363b9c32f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26964ed-5b, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc26964ed-5b, col_values=(('qos', UUID('8e7110de-4b14-4926-aa24-5d8d652390be')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc26964ed-5b, col_values=(('external_ids', {'iface-id': 'c26964ed-5bb7-4522-9569-b08e7b085ca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:16:e5', 'vm-uuid': 'af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:13 user nova-compute[74507]: INFO os_vif [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b')
Oct 25 22:58:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:1b:16:e5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:58:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:14 user nova-compute[74507]: WARNING nova.compute.manager [req-14bca09d-fdc0-4ad7-91d4-58575a15cd0d req-658bd15a-a786-4762-87b1-2ce06273845b service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state building and task_state spawning.
Oct 25 22:58:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:16 user nova-compute[74507]: WARNING nova.compute.manager [req-b67b1f5c-22c3-4f36-ae6b-1871b70159ac req-5c4ce31a-40f7-4df9-8438-fa0bb42ab872 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state building and task_state spawning.
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:58:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance spawned successfully.
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:16 user nova-compute[74507]: INFO nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 25 22:58:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:17 user nova-compute[74507]: INFO nova.compute.manager [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Took 30.51 seconds to build instance.
Oct 25 22:58:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8e2602b4-1271-40c2-a99a-1a883196d445 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.642s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:19 user nova-compute[74507]: INFO nova.compute.manager [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Terminating instance
Oct 25 22:58:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Instance destroyed successfully.
Oct 25 22:58:19 user nova-compute[74507]: DEBUG nova.objects.instance [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lazy-loading 'resources' on Instance uuid cee2d99c-cce8-419f-91da-6523af9313de {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-123315516',display_name='tempest-ServerStableDeviceRescueTest-server-123315516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-123315516',id=15,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpe2IRONnb0xgkJx6uZg38h61XSHtvO5NFx3sD3tfLVdKh+b1XxahLfXTVU4/jxSU10q4Wit0gwtTz14BSgjIGCtAtwmulcZYr+hNERiHFJ7YCDDeT7aurJbAm8t2TWbQ==',key_name='tempest-keypair-1491349958',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b24efb14e4e4cb5bbd66e4cb95f8ab5',ramdisk_id='',reservation_id='r-5stnyukm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-993087249',owner_user_name='tempest-ServerStableDeviceRescueTest-993087249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d2d8917cc004c9b9efaee4a226d4374',uuid=cee2d99c-cce8-419f-91da-6523af9313de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converting VIF {"id": "fe9f8da9-003e-4568-accb-67509146fef1", "address": "fa:16:3e:48:08:c9", "network": {"id": "5886f97f-f736-4a05-aa5b-8b656c881b1c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385636477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b24efb14e4e4cb5bbd66e4cb95f8ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9f8da9-00", "ovs_interfaceid": "fe9f8da9-003e-4568-accb-67509146fef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG os_vif [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9f8da9-00, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f083148-a3ae-426d-b9ba-0193c277ab5a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:19 user nova-compute[74507]: INFO os_vif [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:c9,bridge_name='br-int',has_traffic_filtering=True,id=fe9f8da9-003e-4568-accb-67509146fef1,network=Network(5886f97f-f736-4a05-aa5b-8b656c881b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9f8da9-00')
Oct 25 22:58:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Deleting instance files /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de_del
Oct 25 22:58:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Deletion of /opt/stack/data/nova/instances/cee2d99c-cce8-419f-91da-6523af9313de_del complete
Oct 25 22:58:20 user nova-compute[74507]: INFO nova.compute.manager [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 25 22:58:20 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 22:58:20 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 22:58:20 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 22:58:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] Acquiring lock "cee2d99c-cce8-419f-91da-6523af9313de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] Lock "cee2d99c-cce8-419f-91da-6523af9313de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] No waiting events found dispatching network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:21 user nova-compute[74507]: WARNING nova.compute.manager [req-8c472fbb-9ece-4999-a637-25fda4e2ce63 req-d3a96db7-0b48-4473-9afc-b480a82502e4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received unexpected event network-vif-plugged-fe9f8da9-003e-4568-accb-67509146fef1 for instance with vm_state active and task_state deleting.
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:21 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Took 1.16 seconds to deallocate network for instance.
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-3bf76a02-9976-40a6-ac31-e08bcca095a6 req-45bf13b3-0036-4efb-99cc-6c7c8dd90cd4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Received event network-vif-deleted-fe9f8da9-003e-4568-accb-67509146fef1 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:21 user nova-compute[74507]: INFO nova.compute.manager [req-3bf76a02-9976-40a6-ac31-e08bcca095a6 req-45bf13b3-0036-4efb-99cc-6c7c8dd90cd4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Neutron deleted interface fe9f8da9-003e-4568-accb-67509146fef1; detaching it from the instance and deleting it from the info cache
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-3bf76a02-9976-40a6-ac31-e08bcca095a6 req-45bf13b3-0036-4efb-99cc-6c7c8dd90cd4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-3bf76a02-9976-40a6-ac31-e08bcca095a6 req-45bf13b3-0036-4efb-99cc-6c7c8dd90cd4 service nova] [instance: cee2d99c-cce8-419f-91da-6523af9313de] Detach interface failed, port_id=fe9f8da9-003e-4568-accb-67509146fef1, reason: Instance cee2d99c-cce8-419f-91da-6523af9313de could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:58:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:22 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Deleted allocations for instance cee2d99c-cce8-419f-91da-6523af9313de
Oct 25 22:58:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-23c533e3-817e-4887-9f93-3464811b0833 tempest-ServerStableDeviceRescueTest-993087249 tempest-ServerStableDeviceRescueTest-993087249-project-member] Lock "cee2d99c-cce8-419f-91da-6523af9313de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing instance network info cache due to event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updated VIF entry in instance network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5c8db1bc-66aa-45a9-bec9-3c752722722c req-1a535e58-75fa-4455-b420-c92a959a6833 service nova] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:58:25 user nova-compute[74507]: INFO nova.compute.claims [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Claim successful on node user
Oct 25 22:58:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:58:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.policy [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2bd439fd8ec46f89ab4dba1021525d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb3fed6110e44d6ba6922cf016d07e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:58:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Creating image(s)
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Successfully created port: 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:58:27 user nova-compute[74507]: INFO nova.compute.manager [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Unrescuing
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.part --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG nova.virt.images [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] 2f80a88e-f2c3-4a17-bfb9-14f22ebf231d was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.part /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.part /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.converted" returned: 0 in 0.449s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.554s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Successfully updated port: 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing instance network info cache due to event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'flavor' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json" returned: 0 in 0.238s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622,backing_fmt=raw /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622,backing_fmt=raw /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk 1073741824" returned: 0 in 0.064s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "55e7c84ae1be8bcbc6efcead5a18928a7c177622" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json" returned: 0 in 0.223s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance network_info: |[{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Cannot resize image /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Ensure instance console log exists: /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start _get_guest_xml network_info=[{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:58:22Z,direct_url=<?>,disk_format='qcow2',id=2f80a88e-f2c3-4a17-bfb9-14f22ebf231d,min_disk=0,min_ram=0,name='tempest-scenario-img--1679075695',owner='9eb3fed6110e44d6ba6922cf016d07e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:58:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '2f80a88e-f2c3-4a17-bfb9-14f22ebf231d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:58:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:58:22Z,direct_url=<?>,disk_format='qcow2',id=2f80a88e-f2c3-4a17-bfb9-14f22ebf231d,min_disk=0,min_ram=0,name='tempest-scenario-img--1679075695',owner='9eb3fed6110e44d6ba6922cf016d07e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:58:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:58:26Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:58:29 user nova-compute[74507]:   <uuid>96c4f0c8-0ed6-413b-9c85-3327c0317a19</uuid>
Oct 25 22:58:29 user nova-compute[74507]:   <name>instance-0000001a</name>
Oct 25 22:58:29 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:58:29 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:58:29 user nova-compute[74507]:   <metadata>
Oct 25 22:58:29 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:58:29 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:name>tempest-TestMinimumBasicScenario-server-1757322610</nova:name>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:58:29</nova:creationTime>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:58:29 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:58:29 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:owner>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:user uuid="a2bd439fd8ec46f89ab4dba1021525d2">tempest-TestMinimumBasicScenario-1674517596-project-member</nova:user>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:project uuid="9eb3fed6110e44d6ba6922cf016d07e8">tempest-TestMinimumBasicScenario-1674517596</nova:project>
Oct 25 22:58:29 user nova-compute[74507]:       </nova:owner>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:root type="image" uuid="2f80a88e-f2c3-4a17-bfb9-14f22ebf231d"/>
Oct 25 22:58:29 user nova-compute[74507]:       <nova:ports>
Oct 25 22:58:29 user nova-compute[74507]:         <nova:port uuid="2dad3624-c2f3-4ff5-bad3-e755c3204a39">
Oct 25 22:58:29 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 22:58:29 user nova-compute[74507]:         </nova:port>
Oct 25 22:58:29 user nova-compute[74507]:       </nova:ports>
Oct 25 22:58:29 user nova-compute[74507]:     </nova:instance>
Oct 25 22:58:29 user nova-compute[74507]:   </metadata>
Oct 25 22:58:29 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:58:29 user nova-compute[74507]:     <system>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="serial">96c4f0c8-0ed6-413b-9c85-3327c0317a19</entry>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="uuid">96c4f0c8-0ed6-413b-9c85-3327c0317a19</entry>
Oct 25 22:58:29 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:58:29 user nova-compute[74507]:     </system>
Oct 25 22:58:29 user nova-compute[74507]:   </sysinfo>
Oct 25 22:58:29 user nova-compute[74507]:   <os>
Oct 25 22:58:29 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:58:29 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:58:29 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:58:29 user nova-compute[74507]:   </os>
Oct 25 22:58:29 user nova-compute[74507]:   <features>
Oct 25 22:58:29 user nova-compute[74507]:     <acpi/>
Oct 25 22:58:29 user nova-compute[74507]:     <apic/>
Oct 25 22:58:29 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:58:29 user nova-compute[74507]:   </features>
Oct 25 22:58:29 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:58:29 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:58:29 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:58:29 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:58:29 user nova-compute[74507]:   </clock>
Oct 25 22:58:29 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:58:29 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:58:29 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:58:29 user nova-compute[74507]:   </cpu>
Oct 25 22:58:29 user nova-compute[74507]:   <devices>
Oct 25 22:58:29 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:58:29 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:58:29 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk"/>
Oct 25 22:58:29 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:58:29 user nova-compute[74507]:     </disk>
Oct 25 22:58:29 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:58:29 user nova-compute[74507]:       <mac address="fa:16:3e:e3:3b:9f"/>
Oct 25 22:58:29 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:29 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:58:29 user nova-compute[74507]:       <target dev="tap2dad3624-c2"/>
Oct 25 22:58:29 user nova-compute[74507]:     </interface>
Oct 25 22:58:29 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:58:29 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/console.log" append="off"/>
Oct 25 22:58:29 user nova-compute[74507]:     </serial>
Oct 25 22:58:29 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:58:29 user nova-compute[74507]:     <video>
Oct 25 22:58:29 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:29 user nova-compute[74507]:     </video>
Oct 25 22:58:29 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:58:29 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:58:29 user nova-compute[74507]:     </rng>
Oct 25 22:58:29 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:58:29 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:58:29 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:58:29 user nova-compute[74507]:     </memballoon>
Oct 25 22:58:29 user nova-compute[74507]:   </devices>
Oct 25 22:58:29 user nova-compute[74507]: </domain>
Oct 25 22:58:29 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:58:26Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG os_vif [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8898548b-5d53-5da5-bf31-16f538abf30f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dad3624-c2, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dad3624-c2, col_values=(('qos', UUID('792ef771-02a5-4837-9319-a638004ea6d9')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dad3624-c2, col_values=(('external_ids', {'iface-id': '2dad3624-c2f3-4ff5-bad3-e755c3204a39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:3b:9f', 'vm-uuid': '96c4f0c8-0ed6-413b-9c85-3327c0317a19'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:29 user nova-compute[74507]: INFO os_vif [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2')
Oct 25 22:58:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance destroyed successfully.
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No VIF found with MAC fa:16:3e:e3:3b:9f, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updated VIF entry in instance network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07f658ca-06dc-4f17-a159-34dfc45f54d0 req-2d477bd9-d9aa-437c-9d37-f4812dd5841a service nova] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:30 user nova-compute[74507]: WARNING nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:58:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:30 user nova-compute[74507]: WARNING nova.compute.manager [req-9563b8e5-0e10-4e7d-b734-b54d115e6b49 req-c305bec6-d26e-418d-97ce-4b1e5c75b6d4 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:32 user nova-compute[74507]: WARNING nova.compute.manager [req-88b9c24a-bbe6-47cc-b106-7b7f02100bb5 req-50cf342b-60ea-4bfd-8918-70bf016f929b service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state building and task_state spawning.
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:32 user nova-compute[74507]: WARNING nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:32 user nova-compute[74507]: WARNING nova.compute.manager [req-ccbd128d-3b76-4a95-8023-c642bb018280 req-c7f02c3d-34f6-4a43-be5e-c6a0ecb95274 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state rescued and task_state unrescuing.
Oct 25 22:58:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:58:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 22:58:33 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:34 user nova-compute[74507]: WARNING nova.compute.manager [req-7eee1a5a-a0e6-490c-b48c-64e81c50baa0 req-e610804b-25bf-4539-a49b-14d794caccea service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state building and task_state spawning.
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4a1c146c-46bd-4a31-80b8-94440d8baf01 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:58:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance spawned successfully.
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:58:35 user nova-compute[74507]: INFO nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Took 8.61 seconds to spawn the instance on the hypervisor.
Oct 25 22:58:35 user nova-compute[74507]: DEBUG nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:35 user nova-compute[74507]: INFO nova.compute.manager [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Took 9.52 seconds to build instance.
Oct 25 22:58:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-906477f9-9983-44b3-a307-c9e9228a4321 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.651s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:36 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:58:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:39 user nova-compute[74507]: INFO nova.compute.manager [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Shelving
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:58:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:40 user nova-compute[74507]: WARNING nova.compute.manager [req-cabc2e01-0149-45ac-99aa-f4eb50b20e9d req-dc3089b0-587e-4c92-a729-ca7c16550c9a service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state active and task_state shelving.
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance destroyed successfully.
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Beginning cold snapshot process
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:58:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk /opt/stack/data/nova/instances/snapshots/tmpqz_0227f/9bbf0835e67542c9beac1868fb310d88 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk /opt/stack/data/nova/instances/snapshots/tmpqz_0227f/9bbf0835e67542c9beac1868fb310d88" returned: 0 in 0.918s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Snapshot extracted, beginning image upload
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:58:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:42 user nova-compute[74507]: WARNING nova.compute.manager [req-cabd9b83-7adf-4281-ad44-abc01972f026 req-cf52c06e-f8a8-4a4e-916e-7b52d5b600a6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:42 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:42 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:42 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.130664825439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:58:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:44 user nova-compute[74507]: INFO nova.compute.manager [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Rescuing
Oct 25 22:58:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:44 user nova-compute[74507]: DEBUG nova.network.neutron [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:45 user nova-compute[74507]: WARNING nova.compute.manager [req-5ae8b319-5b35-477f-9c18-24086090a891 req-eaafc86e-f3d4-463a-b74e-0614728b382c service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state active and task_state rescuing.
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance destroyed successfully.
Oct 25 22:58:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Attempting a stable device rescue
Oct 25 22:58:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 22:58:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Creating image(s)
Oct 25 22:58:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Snapshot image upload complete
Oct 25 22:58:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:47 user nova-compute[74507]: INFO nova.compute.manager [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Shelve offloading
Oct 25 22:58:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance destroyed successfully.
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.virt.images [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] aeb00d41-7ea1-4c00-92a2-4c4b114d41e0 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.part /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:47 user nova-compute[74507]: WARNING nova.compute.manager [req-f9547453-1ad8-4293-8937-5dff154ea2fa req-1eabe13d-db00-4694-9696-6efe6dc41896 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state active and task_state rescuing.
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.part /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.converted" returned: 0 in 0.574s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.187s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf --force-share --output=json" returned: 0 in 0.259s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf,backing_fmt=raw /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf,backing_fmt=raw /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2a5604c8998053725ba1fb7c2cd9bd62d68c2adf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'migration_context' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<2b5116dc-7dd3-414b-89d6-9c318a41a63f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start _get_guest_xml network_info=[{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:bc:0e:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aeb00d41-7ea1-4c00-92a2-4c4b114d41e0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4ff34a27-6664-4c30-8153-fc02217e700f', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2b5116dc-7dd3-414b-89d6-9c318a41a63f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'serial': 'c648b3e0-bbc4-4f43-ae33-78b1ed95fede'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<2b5116dc-7dd3-414b-89d6-9c318a41a63f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<2b5116dc-7dd3-414b-89d6-9c318a41a63f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:48 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:48 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.objects.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<2b5116dc-7dd3-414b-89d6-9c318a41a63f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:58:48 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:58:48 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:58:48 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba9ea2-a0e1-4304-a149-5b4868c6afdc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JVFkNHid\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 22:58:48 user nova-compute[74507]: node.name = iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 22:58:48 user nova-compute[74507]: node.tpgt = -1
Oct 25 22:58:48 user nova-compute[74507]: node.startup = automatic
Oct 25 22:58:48 user nova-compute[74507]: node.leading_login = No
Oct 25 22:58:48 user nova-compute[74507]: iface.iscsi_ifacename = default
Oct 25 22:58:48 user nova-compute[74507]: iface.net_ifacename = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.ipaddress = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.prefix_len = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.hwaddress = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.transport_name = tcp
Oct 25 22:58:48 user nova-compute[74507]: iface.initiatorname = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.vlan_id = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.vlan_priority = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.vlan_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.iface_num = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.mtu = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.port = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.bootproto = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.subnet_mask = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.gateway = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_alt_client_id = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_dns = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_learn_iqn = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_vendor_id_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_vendor_id = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.dhcp_slp_da = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.fragmentation = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.gratuitous_arp = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.incoming_forwarding = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.tos_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.tos = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.ttl = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.delayed_ack = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.tcp_nagle = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.tcp_wsf_state = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.tcp_wsf = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.tcp_timer_scale = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.tcp_timestamp = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.redirect = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.def_task_mgmt_timeout = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.header_digest = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.data_digest = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.immediate_data = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.initial_r2t = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.data_seq_inorder = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.data_pdu_inorder = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.erl = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.max_receive_data_len = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.first_burst_len = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.max_outstanding_r2t = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.max_burst_len = 0
Oct 25 22:58:48 user nova-compute[74507]: iface.chap_auth = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.bidi_chap = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.strict_login_compliance = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.discovery_auth = <empty>
Oct 25 22:58:48 user nova-compute[74507]: iface.discovery_logout = <empty>
Oct 25 22:58:48 user nova-compute[74507]: node.discovery_address = <empty>
Oct 25 22:58:48 user nova-compute[74507]: node.discovery_port = 0
Oct 25 22:58:48 user nova-compute[74507]: node.discovery_type = static
Oct 25 22:58:48 user nova-compute[74507]: node.session.initial_cmdsn = 0
Oct 25 22:58:48 user nova-compute[74507]: node.session.initial_login_retry_max = 8
Oct 25 22:58:48 user nova-compute[74507]: node.session.xmit_thread_priority = -20
Oct 25 22:58:48 user nova-compute[74507]: node.session.cmds_max = 128
Oct 25 22:58:48 user nova-compute[74507]: node.session.queue_depth = 32
Oct 25 22:58:48 user nova-compute[74507]: node.session.nr_sessions = 1
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.authmethod = CHAP
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.username = JVFkNHid
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.password = ***
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.username_in = <empty>
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.password_in = <empty>
Oct 25 22:58:48 user nova-compute[74507]: node.session.auth.chap_algs = MD5
Oct 25 22:58:48 user nova-compute[74507]: node.session.timeo.replacement_timeout = 120
Oct 25 22:58:48 user nova-compute[74507]: node.session.err_timeo.abort_timeout = 15
Oct 25 22:58:48 user nova-compute[74507]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 22:58:48 user nova-compute[74507]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 22:58:48 user nova-compute[74507]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.FastAbort = Yes
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.InitialR2T = No
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.ImmediateData = Yes
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.MaxConnections = 1
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 22:58:48 user nova-compute[74507]: node.session.iscsi.ERL = 0
Oct 25 22:58:48 user nova-compute[74507]: node.session.scan = manual
Oct 25 22:58:48 user nova-compute[74507]: node.session.reopen_max = 0
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].address = 172.16.0.220
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].port = 3260
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].startup = manual
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].tcp.window_size = 524288
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].tcp.type_of_service = 0
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].timeo.logout_timeout = 15
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].timeo.login_timeout = 15
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].timeo.auth_timeout = 45
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.DataDigest = None
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.IFMarker = No
Oct 25 22:58:48 user nova-compute[74507]: node.conn[0].iscsi.OFMarker = No
Oct 25 22:58:48 user nova-compute[74507]: # END RECORD
Oct 25 22:58:48 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a4b352-e807-4b14-bf71-f0bc8804a3a5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ec4f28-f318-4f7d-8b96-188774ba4358]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVFkNHid {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVFkNHid" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[16683e99-b53c-44fb-9dda-b03477f172fb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVFkNHid'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46754d-3501-4a32-83a1-a5b723784572]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[29316b11-bafd-4864-8b40-1d775815f50e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:48 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:48 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:58:48 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:58:48 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:58:48 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:58:48 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.198s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] HCTL ('34', '0', '0', 0) found on session 27 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:58:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea252d81-330b-4d87-a365-cbd805086636]: (4, ('0 0 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching for a device in session 27 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== connect_volume: return (248ms) {'type': 'block', 'scsi_wwn': '26630633563383938', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633563383938', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-784031805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-784031805',id=23,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:57:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-67n5t0ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:57:29Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=2b5116dc-7dd3-414b-89d6-9c318a41a63f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:bc:0e:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:bc:0e:c9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.objects.instance [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.objects.base [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<2b5116dc-7dd3-414b-89d6-9c318a41a63f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:58:49 user nova-compute[74507]:   <uuid>2b5116dc-7dd3-414b-89d6-9c318a41a63f</uuid>
Oct 25 22:58:49 user nova-compute[74507]:   <name>instance-00000017</name>
Oct 25 22:58:49 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:58:49 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:58:49 user nova-compute[74507]:   <metadata>
Oct 25 22:58:49 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:58:49 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-784031805</nova:name>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:58:48</nova:creationTime>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:58:49 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:58:49 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:owner>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 22:58:49 user nova-compute[74507]:       </nova:owner>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:58:49 user nova-compute[74507]:       <nova:ports>
Oct 25 22:58:49 user nova-compute[74507]:         <nova:port uuid="e304d3b5-349e-4908-a1c6-bb3ed2d92698">
Oct 25 22:58:49 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:58:49 user nova-compute[74507]:         </nova:port>
Oct 25 22:58:49 user nova-compute[74507]:       </nova:ports>
Oct 25 22:58:49 user nova-compute[74507]:     </nova:instance>
Oct 25 22:58:49 user nova-compute[74507]:   </metadata>
Oct 25 22:58:49 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:58:49 user nova-compute[74507]:     <system>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="serial">2b5116dc-7dd3-414b-89d6-9c318a41a63f</entry>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="uuid">2b5116dc-7dd3-414b-89d6-9c318a41a63f</entry>
Oct 25 22:58:49 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:58:49 user nova-compute[74507]:     </system>
Oct 25 22:58:49 user nova-compute[74507]:   </sysinfo>
Oct 25 22:58:49 user nova-compute[74507]:   <os>
Oct 25 22:58:49 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:58:49 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:58:49 user nova-compute[74507]:   </os>
Oct 25 22:58:49 user nova-compute[74507]:   <features>
Oct 25 22:58:49 user nova-compute[74507]:     <acpi/>
Oct 25 22:58:49 user nova-compute[74507]:     <apic/>
Oct 25 22:58:49 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:58:49 user nova-compute[74507]:   </features>
Oct 25 22:58:49 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:58:49 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:58:49 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:58:49 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:58:49 user nova-compute[74507]:   </clock>
Oct 25 22:58:49 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:58:49 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:58:49 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:58:49 user nova-compute[74507]:   </cpu>
Oct 25 22:58:49 user nova-compute[74507]:   <devices>
Oct 25 22:58:49 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:58:49 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:58:49 user nova-compute[74507]:       <source dev="/dev/sdc"/>
Oct 25 22:58:49 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:58:49 user nova-compute[74507]:       <serial>c648b3e0-bbc4-4f43-ae33-78b1ed95fede</serial>
Oct 25 22:58:49 user nova-compute[74507]:     </disk>
Oct 25 22:58:49 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:58:49 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:58:49 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue"/>
Oct 25 22:58:49 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 22:58:49 user nova-compute[74507]:       <boot order="1"/>
Oct 25 22:58:49 user nova-compute[74507]:     </disk>
Oct 25 22:58:49 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:58:49 user nova-compute[74507]:       <mac address="fa:16:3e:bc:0e:c9"/>
Oct 25 22:58:49 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:49 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:58:49 user nova-compute[74507]:       <target dev="tape304d3b5-34"/>
Oct 25 22:58:49 user nova-compute[74507]:     </interface>
Oct 25 22:58:49 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:58:49 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/console.log" append="off"/>
Oct 25 22:58:49 user nova-compute[74507]:     </serial>
Oct 25 22:58:49 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:58:49 user nova-compute[74507]:     <video>
Oct 25 22:58:49 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:58:49 user nova-compute[74507]:     </video>
Oct 25 22:58:49 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:58:49 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:58:49 user nova-compute[74507]:     </rng>
Oct 25 22:58:49 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:58:49 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:58:49 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:58:49 user nova-compute[74507]:     </memballoon>
Oct 25 22:58:49 user nova-compute[74507]:   </devices>
Oct 25 22:58:49 user nova-compute[74507]: </domain>
Oct 25 22:58:49 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:58:49 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance destroyed successfully.
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:bc:0e:c9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:49 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance destroyed successfully.
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'resources' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0hiv9yMtDjZTMkufqi5csgWB0Phha38jJy5AW02qg2ZcXsPpjrurEkOngOSvnqQIhBjDpyYu+yzfVk3U+a0xnzMyVB+K5J14IXj3RByqmPJtdMhnilfmU4yluKgF/zSg==',key_name='tempest-keypair-383944364',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T22:58:46.230770',shelved_host='user',shelved_image_id='e310bba2-9e18-4010-b434-671a5ed3dab3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG os_vif [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cb8c7f9-45, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing instance network info cache due to event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.network.neutron [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce6eee19-a848-4c92-b157-e532151e9f12) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:49 user nova-compute[74507]: INFO os_vif [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45')
Oct 25 22:58:49 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Deleting instance files /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907_del
Oct 25 22:58:49 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Deletion of /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907_del complete
Oct 25 22:58:49 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Deleted allocations for instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'numa_topology' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:49 user nova-compute[74507]: DEBUG nova.objects.base [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<c59e7e75-ee1c-4751-8ef2-b46f80c9d907> lazy-loaded attributes: resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updated VIF entry in instance network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8b9ff8a3-f8c4-4e63-ada7-df3029b94216 req-a2000a25-817f-41a3-aa85-a03118bd1d37 service nova] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.681s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c7037231-4968-4563-9d2d-3dc97fe5f093 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 11.177s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-changed-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Refreshing instance network info cache due to event network-changed-f0102a28-943c-468a-95ee-b6d38224147e. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] Acquiring lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] Acquired lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Refreshing network info cache for port f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updated VIF entry in instance network info cache for port f0102a28-943c-468a-95ee-b6d38224147e. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG nova.network.neutron [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating instance_info_cache with network_info: [{"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:58:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a35102eb-fb1c-4816-a65a-230b4caf4fac req-0566103a-306a-4f4c-bf99-c2ffa341af6c service nova] Releasing lock "refresh_cache-95222a21-d30d-4541-ad93-2bf6ec9eb7f2" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:58:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-33a0a85e-f849-49b0-a44b-ec9c39be5e6d tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:58:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:54 user nova-compute[74507]: WARNING nova.compute.manager [req-54625246-5c7d-452e-a175-66cae39dfe04 req-06b7f358-cd1b-4072-b265-ef0ee2d7ecd5 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state rescued and task_state None.
Oct 25 22:58:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:58:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:58:56 user nova-compute[74507]: WARNING nova.compute.manager [req-e936243b-37b9-4727-999c-19932afc44a7 req-efe6dc7e-3f7b-4438-82aa-7d12d17b69b1 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state rescued and task_state None.
Oct 25 22:58:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.374s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:58:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:58:58 user nova-compute[74507]: INFO nova.compute.manager [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attaching volume 539b8850-a30c-45f6-a893-7168543a6562 to /dev/vdb
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0ba138-3e4e-4168-a1ff-f66e210f69d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd6e13-3ac1-4418-a645-e68cbc622877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64987960-3982-4dfc-b0f9-3b18d9991c29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2624733b-80f8-4f59-b096-1444c7c59e78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:58:59 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:58:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db70f88-f0d4-48de-af53-5b9b219dc4d0]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating existing volume attachment record: c2f32625-7bcc-4ddf-a44a-26987287f938 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:58:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEbfOCyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:19 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b27adb-8c1e-4021-945e-869a791b73a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:59:19 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9192c78-2ac8-4239-b881-b6c511396446]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562] added
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcb7a0-d74f-4b3f-9c13-29e833519427]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66df72-0247-4432-a59f-278e289feca7]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEbfOCyk {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEbfOCyk" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64804106-fe11-4259-b0fd-5cf232c6334c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEbfOCyk'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3527b13-8af0-4c5f-be7f-505b9eebb587]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb0e423-7556-4810-85a8-ef2c886d224e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb3a8a0-e24f-4475-a26a-7e964d3670d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260]
Oct 25 22:59:19 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260] successful.
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd608573-df1e-4b5a-a2f6-64874ab3dd77]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac7b945-e308-4775-87d7-e7b90e0df7bb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794110d-c725-44f5-ac2f-05be3d633844]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:59:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEbfOCyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:59:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26562356361333866', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562356361333866', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:59:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:59:20 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:59:20 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:59:20 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:59:20 user nova-compute[74507]:   <serial>539b8850-a30c-45f6-a893-7168543a6562</serial>
Oct 25 22:59:20 user nova-compute[74507]: </disk>
Oct 25 22:59:20 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:59:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No VIF found with MAC fa:16:3e:e6:6e:89, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:59:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6f1ec550-4508-4b45-a2d1-b6596e29c3cb tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.245s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:27 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:28 user nova-compute[74507]: INFO nova.compute.manager [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attaching volume 73bbd954-2b7b-4459-b53e-4166608b3995 to /dev/vdc
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.utils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd03b934-c102-4de0-8eae-f6bc81123f3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dceaa9-8c3a-4925-be19-9a39cc5a3360]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[178be549-d623-4c64-95b8-d1f7b8581980]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17260574-97f6-4079-9310-975fcce60880]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:28 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:59:28 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878f5a7-caec-4579-8ad5-ea5bc583d17f]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG os_brick.utils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:28 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating existing volume attachment record: e16bde0c-ff5b-414c-a417-fb173b4253a5 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:59:29 user nova-compute[74507]: INFO nova.compute.claims [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Claim successful on node user
Oct 25 22:59:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:59:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:59:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:59:29 user nova-compute[74507]: INFO nova.virt.block_device [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Booting with volume snapshot a5024166-86d4-49a6-b96d-c73aa50322cd at /dev/vda
Oct 25 22:59:30 user nova-compute[74507]: DEBUG nova.policy [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:59:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Successfully created port: e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Successfully updated port: e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-changed-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Refreshing instance network info cache due to event network-changed-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] Acquiring lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Updating instance_info_cache with network_info: [{"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Instance network_info: |[{"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] Acquired lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Refreshing network info cache for port e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Updated VIF entry in instance network info cache for port e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:59:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Updating instance_info_cache with network_info: [{"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d7f05e16-2fc9-4469-a938-93be45aac743 req-8aee725a-4595-4e43-9216-94324ea33df6 service nova] Releasing lock "refresh_cache-adf51865-638e-4b5b-a659-48225c878b51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: adf51865-638e-4b5b-a659-48225c878b51] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 22:59:34 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [{"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de04d5f3-1651-4661-bc81-390182180af3" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.utils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeae949-4ec5-4003-9e9a-de15e40b7891]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525abfe-9fb0-4167-9907-09182e29997a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27677bd3-3c74-4e73-960b-072a53fc534a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[275d857f-f171-4afc-af29-28deec69be0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:35 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:59:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c167fdd8-d92d-4e0c-89dd-a9c16afe64d5]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG os_brick.utils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:35 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Updating existing volume attachment record: 31b02969-d009-4858-961a-958ab805d070 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:59:36 user nova-compute[74507]: INFO nova.compute.claims [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Claim successful on node user
Oct 25 22:59:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 22:59:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.policy [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b65985ef3b8403da48b609e49da19db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63880132a8984ca2bdfb3e226b65a093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:59:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Creating image(s)
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "/opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk 1073741824" returned: 0 in 0.085s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Successfully created port: e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing instance network info cache due to event network-changed-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Refreshing network info cache for port a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Cannot resize image /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updated VIF entry in instance network info cache for port a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-619b6de4-1bb2-4a84-844a-022b8186af2c req-e19f5600-b7f3-4ec7-b075-31c2a9d1027b service nova] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Successfully updated port: e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquired lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-changed-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Refreshing instance network info cache due to event network-changed-e617056b-f3a5-4bd5-a5c5-717a0870bb03. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] Acquiring lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updating instance_info_cache with network_info: [{"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Releasing lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Instance network_info: |[{"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] Acquired lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Refreshing network info cache for port e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Start _get_guest_xml network_info=[{"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:59:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1206958500',display_name='tempest-AttachVolumeNegativeTest-server-1206958500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1206958500',id=28,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6w2pVOJyT41d1O9gMl/m3iCS460zvW36eVls8xYsxQIQtspV03INDeNptL8NQGGAQ5/cmzKlP/JUPcrr+h3YaYQxfAMWHwS3q99KX3TP9RfhG85sDU9ziyGLNDki2STw==',key_name='tempest-keypair-661284452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-affdvyrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=987398c5-0ff2-4280-bfcb-e24f2c839aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'pci_devices' on Instance uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:59:38 user nova-compute[74507]:   <uuid>987398c5-0ff2-4280-bfcb-e24f2c839aa1</uuid>
Oct 25 22:59:38 user nova-compute[74507]:   <name>instance-0000001c</name>
Oct 25 22:59:38 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:59:38 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:59:38 user nova-compute[74507]:   <metadata>
Oct 25 22:59:38 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:59:38 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1206958500</nova:name>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:59:38</nova:creationTime>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:59:38 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:59:38 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:owner>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:user uuid="8b65985ef3b8403da48b609e49da19db">tempest-AttachVolumeNegativeTest-231270075-project-member</nova:user>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:project uuid="63880132a8984ca2bdfb3e226b65a093">tempest-AttachVolumeNegativeTest-231270075</nova:project>
Oct 25 22:59:38 user nova-compute[74507]:       </nova:owner>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 22:59:38 user nova-compute[74507]:       <nova:ports>
Oct 25 22:59:38 user nova-compute[74507]:         <nova:port uuid="e617056b-f3a5-4bd5-a5c5-717a0870bb03">
Oct 25 22:59:38 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 22:59:38 user nova-compute[74507]:         </nova:port>
Oct 25 22:59:38 user nova-compute[74507]:       </nova:ports>
Oct 25 22:59:38 user nova-compute[74507]:     </nova:instance>
Oct 25 22:59:38 user nova-compute[74507]:   </metadata>
Oct 25 22:59:38 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:59:38 user nova-compute[74507]:     <system>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="serial">987398c5-0ff2-4280-bfcb-e24f2c839aa1</entry>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="uuid">987398c5-0ff2-4280-bfcb-e24f2c839aa1</entry>
Oct 25 22:59:38 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:59:38 user nova-compute[74507]:     </system>
Oct 25 22:59:38 user nova-compute[74507]:   </sysinfo>
Oct 25 22:59:38 user nova-compute[74507]:   <os>
Oct 25 22:59:38 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:59:38 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:59:38 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:59:38 user nova-compute[74507]:   </os>
Oct 25 22:59:38 user nova-compute[74507]:   <features>
Oct 25 22:59:38 user nova-compute[74507]:     <acpi/>
Oct 25 22:59:38 user nova-compute[74507]:     <apic/>
Oct 25 22:59:38 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:59:38 user nova-compute[74507]:   </features>
Oct 25 22:59:38 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:59:38 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:59:38 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:59:38 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:59:38 user nova-compute[74507]:   </clock>
Oct 25 22:59:38 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:59:38 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:59:38 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:59:38 user nova-compute[74507]:   </cpu>
Oct 25 22:59:38 user nova-compute[74507]:   <devices>
Oct 25 22:59:38 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 22:59:38 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 22:59:38 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk"/>
Oct 25 22:59:38 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:59:38 user nova-compute[74507]:     </disk>
Oct 25 22:59:38 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:59:38 user nova-compute[74507]:       <mac address="fa:16:3e:f7:be:f5"/>
Oct 25 22:59:38 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:59:38 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:59:38 user nova-compute[74507]:       <target dev="tape617056b-f3"/>
Oct 25 22:59:38 user nova-compute[74507]:     </interface>
Oct 25 22:59:38 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:59:38 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/console.log" append="off"/>
Oct 25 22:59:38 user nova-compute[74507]:     </serial>
Oct 25 22:59:38 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:59:38 user nova-compute[74507]:     <video>
Oct 25 22:59:38 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:59:38 user nova-compute[74507]:     </video>
Oct 25 22:59:38 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:59:38 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:59:38 user nova-compute[74507]:     </rng>
Oct 25 22:59:38 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:59:38 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:59:38 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:59:38 user nova-compute[74507]:     </memballoon>
Oct 25 22:59:38 user nova-compute[74507]:   </devices>
Oct 25 22:59:38 user nova-compute[74507]: </domain>
Oct 25 22:59:38 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1206958500',display_name='tempest-AttachVolumeNegativeTest-server-1206958500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1206958500',id=28,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6w2pVOJyT41d1O9gMl/m3iCS460zvW36eVls8xYsxQIQtspV03INDeNptL8NQGGAQ5/cmzKlP/JUPcrr+h3YaYQxfAMWHwS3q99KX3TP9RfhG85sDU9ziyGLNDki2STw==',key_name='tempest-keypair-661284452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-affdvyrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=987398c5-0ff2-4280-bfcb-e24f2c839aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG os_vif [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cca023f7-2206-508f-bff0-b0de1938827e', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape617056b-f3, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape617056b-f3, col_values=(('qos', UUID('2bb9ca87-013b-4ff5-9b4c-792d0533b94c')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape617056b-f3, col_values=(('external_ids', {'iface-id': 'e617056b-f3a5-4bd5-a5c5-717a0870bb03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:be:f5', 'vm-uuid': '987398c5-0ff2-4280-bfcb-e24f2c839aa1'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:38 user nova-compute[74507]: INFO os_vif [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3')
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:f7:be:f5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG nova.network.neutron [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updated VIF entry in instance network info cache for port e617056b-f3a5-4bd5-a5c5-717a0870bb03. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG nova.network.neutron [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updating instance_info_cache with network_info: [{"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2c4388df-a16a-4db8-8b72-e5c65e94dfa2 req-0b7b4d0e-e68a-46e8-9c1b-bb3c00dd68f4 service nova] Releasing lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-changed-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Refreshing instance network info cache due to event network-changed-c26964ed-5bb7-4522-9569-b08e7b085ca9. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:39 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Refreshing network info cache for port c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updated VIF entry in instance network info cache for port c26964ed-5bb7-4522-9569-b08e7b085ca9. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e858124-e875-457c-b93a-45f5412d28e9 req-bba68fe7-fa5b-459b-9348-d128faaaf948 service nova] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Stashing vm_state: active {{(pid=74507) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 22:59:40 user nova-compute[74507]: INFO nova.compute.claims [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Claim successful on node user
Oct 25 22:59:40 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating resource usage from migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2
Oct 25 22:59:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.604s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:41 user nova-compute[74507]: INFO nova.compute.manager [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Migrating
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] No waiting events found dispatching network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:59:41 user nova-compute[74507]: WARNING nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received unexpected event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 for instance with vm_state building and task_state spawning.
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] No waiting events found dispatching network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:59:41 user nova-compute[74507]: WARNING nova.compute.manager [req-c55ec7d1-fc5b-4eb0-a35a-fe28f7947621 req-e9f184bf-e096-4802-bd1b-01533a43323e service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received unexpected event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 for instance with vm_state building and task_state spawning.
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Starting migrate_disk_and_power_off {{(pid=74507) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 22:59:42 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Instance spawned successfully.
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:42 user nova-compute[74507]: INFO nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 25 22:59:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: INFO nova.compute.manager [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Took 6.84 seconds to build instance.
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4521b5d-60ee-42cf-9242-fb0607460273 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.972s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance destroyed successfully.
Oct 25 22:59:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 22:59:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=24.97170639038086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26964ed-5b, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e7110de-4b14-4926-aa24-5d8d652390be) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:43 user nova-compute[74507]: INFO os_vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b')
Oct 25 22:59:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ac4bdf-486c-4247-a1b4-cb9736709ae1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 22:59:43 user nova-compute[74507]: No targets found.
Oct 25 22:59:43 user nova-compute[74507]: iSNS:
Oct 25 22:59:43 user nova-compute[74507]: No targets found.
Oct 25 22:59:43 user nova-compute[74507]: STATIC:
Oct 25 22:59:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562
Oct 25 22:59:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:59:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:59:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 22:59:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:59:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:59:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04
Oct 25 22:59:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:59:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:59:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 22:59:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 22:59:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 22:59:43 user nova-compute[74507]: FIRMWARE:
Oct 25 22:59:43 user nova-compute[74507]: No targets found.
Oct 25 22:59:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 22:59:43 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 22:59:43 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f112250-de75-4640-bf60-4f8194745534]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645d92b-f7f2-448c-ad04-69dc70e8f0d7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54491ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Applying migration context for instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e as it has an incoming, in-progress migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2. Migration status is migrating {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 22:59:44 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating resource usage from migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddd3e7-d4cf-4f16-8fc6-b024b38c7c85]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee618a9-edf5-42c6-861b-dd3c0ff9d1e9]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance adf51865-638e-4b5b-a659-48225c878b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c2e8e-8ba7-4210-b997-317787d07a7f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fdf6df-c7ef-4dec-a565-16f6f5b9ccd0]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d51538-076b-42c0-b22f-675d92e413a9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:59:44 user nova-compute[74507]: WARNING nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state active and task_state resize_migrating.
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 22:59:44 user nova-compute[74507]: WARNING nova.compute.manager [req-5e978215-d5e9-4820-b26e-9b15607208a5 req-58dc403a-bcf5-4ff4-afda-1e27eb913b18 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state active and task_state resize_migrating.
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3807d45-e623-4a55-9b4b-39b3af0401e9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]
Oct 25 22:59:44 user nova-compute[74507]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.
Oct 25 22:59:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f6b88-f365-441f-8c6b-2dc641cee548]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== disconnect_volume: return (406ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 22:59:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Port c26964ed-5bb7-4522-9569-b08e7b085ca9 binding to destination host user is already ACTIVE {{(pid=74507) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 22:59:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.utils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14ee736-878d-4a7b-8082-be8717ad0cec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a278ea3-fa9d-4cf1-b40a-a7837b4f1a52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d645f5-ada1-4dd7-8294-6990548e8f13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5cfd72-ef9d-42c3-819b-2b73cfc86f7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 22:59:46 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 22:59:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79361399-e1f1-456b-9cd6-9d656cca2d4a]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 22:59:46 user nova-compute[74507]: DEBUG os_brick.utils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBKOYcEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:49 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:49 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:49 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[29023a64-d154-430c-b6e7-51084db33708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:59:49 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3d78c0-5930-42af-b4c3-c8e0d98d61b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995] added
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b603c-5e01-4c36-8cd0-20d0778d1889]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10102188-921e-4831-9406-8ee7363721be]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBKOYcEA {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RBKOYcEA" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d6296a-03ce-4df3-847c-fa86c0ee16ec]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RBKOYcEA'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da0e83-b7f9-45df-a009-e4b29b4adbd8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e708137-cf20-4af9-a9fc-a8f91c2cbea1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307d8f8-2628-4ba6-a7ac-d4ea5feec0bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260]
Oct 25 22:59:49 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260] successful.
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3607094-06a5-4790-b93e-fc4e7228608c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1605b-3b6d-4ff3-8546-b50a7dba0b4b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:49 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:59:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a0fa9-1498-4bb9-b9a7-dc867cd19211]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:50 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:59:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBKOYcEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23762363931383536', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363931383536', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 22:59:51 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:59:51 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 22:59:51 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 22:59:51 user nova-compute[74507]:   <serial>73bbd954-2b7b-4459-b53e-4166608b3995</serial>
Oct 25 22:59:51 user nova-compute[74507]: </disk>
Oct 25 22:59:51 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] No VIF found with MAC fa:16:3e:e6:6e:89, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:59:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0d6a63e0-edee-4e3d-9572-b0b31f48dc79 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.736s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:52 user nova-compute[74507]: INFO nova.compute.manager [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Detaching volume 539b8850-a30c-45f6-a893-7168543a6562
Oct 25 22:59:52 user nova-compute[74507]: INFO nova.virt.block_device [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attempting to driver detach volume 539b8850-a30c-45f6-a893-7168543a6562 from mountpoint /dev/vdb
Oct 25 22:59:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Attempting to detach device vdb from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 22:59:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:59:52 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:59:52 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:59:52 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:59:52 user nova-compute[74507]:   <serial>539b8850-a30c-45f6-a893-7168543a6562</serial>
Oct 25 22:59:52 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:59:52 user nova-compute[74507]: </disk>
Oct 25 22:59:52 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:59:52 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdb from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the persistent domain config.
Oct 25 22:59:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 22:59:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 22:59:52 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:59:52 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 22:59:52 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 22:59:52 user nova-compute[74507]:   <serial>539b8850-a30c-45f6-a893-7168543a6562</serial>
Oct 25 22:59:52 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 22:59:52 user nova-compute[74507]: </disk>
Oct 25 22:59:52 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 22:59:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 22:59:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Creating image(s)
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Ensure instance console log exists: /opt/stack/data/nova/instances/adf51865-638e-4b5b-a659-48225c878b51/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Start _get_guest_xml network_info=[{"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31b02969-d009-4858-961a-958ab805d070', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUhOcELA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adf51865-638e-4b5b-a659-48225c878b51', 'attached_at': '', 'detached_at': '', 'volume_id': 'f37685f4-49d8-45b7-81ab-575e5f75ad63', 'serial': 'f37685f4-49d8-45b7-81ab-575e5f75ad63'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 22:59:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUhOcELA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 22:59:56 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:56 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 22:59:56 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[596c932a-1d7a-4737-8e88-f815ce6811d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 22:59:56 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3ddd3-6b04-4ea1-9ce0-d0a70d3e7d42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63] added
Oct 25 22:59:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.135s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa6c69-c4d0-4c2c-afda-f4cd64d83b2f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52c81a-cda9-4f3f-be82-27ead2ae823d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUhOcELA {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUhOcELA" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba47050-e374-4d44-8f17-481ddfe7e6f5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUhOcELA'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec183ab-0d37-4a1d-8078-b74c40d5e8c5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c300ca-3533-4b7e-b29b-d8cd69eae025]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6957f757-9cd1-43c9-a7ee-74b0bd47a247]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260]
Oct 25 22:59:57 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260] successful.
Oct 25 22:59:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7f311-de31-4c00-aba2-92d7bc01281a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37b242-70cb-4a28-8350-f0e730044eea]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 22:59:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dcb1b3-984f-4b84-8dbd-9346093539a7]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 22:59:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUhOcELA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23630396138663832', 'path': '/dev/sdf'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630396138663832', 'path': '/dev/sdf'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-94842029',display_name='tempest-TestVolumeBootPattern-server-94842029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-94842029',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-4pvoqnn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:30Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=adf51865-638e-4b5b-a659-48225c878b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid adf51865-638e-4b5b-a659-48225c878b51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] End _get_guest_xml xml=<domain type="kvm">
Oct 25 22:59:58 user nova-compute[74507]:   <uuid>adf51865-638e-4b5b-a659-48225c878b51</uuid>
Oct 25 22:59:58 user nova-compute[74507]:   <name>instance-0000001b</name>
Oct 25 22:59:58 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 22:59:58 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 22:59:58 user nova-compute[74507]:   <metadata>
Oct 25 22:59:58 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 22:59:58 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 22:59:58 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-server-94842029</nova:name>
Oct 25 22:59:58 user nova-compute[74507]:       <nova:creationTime>2023-10-25 22:59:56</nova:creationTime>
Oct 25 22:59:58 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 22:59:58 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 22:59:58 user nova-compute[74507]:       </nova:flavor>
Oct 25 22:59:58 user nova-compute[74507]:       <nova:owner>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 22:59:58 user nova-compute[74507]:       </nova:owner>
Oct 25 22:59:58 user nova-compute[74507]:       <nova:ports>
Oct 25 22:59:58 user nova-compute[74507]:         <nova:port uuid="e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef">
Oct 25 22:59:58 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 22:59:58 user nova-compute[74507]:         </nova:port>
Oct 25 22:59:58 user nova-compute[74507]:       </nova:ports>
Oct 25 22:59:58 user nova-compute[74507]:     </nova:instance>
Oct 25 22:59:58 user nova-compute[74507]:   </metadata>
Oct 25 22:59:58 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 22:59:58 user nova-compute[74507]:     <system>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="serial">adf51865-638e-4b5b-a659-48225c878b51</entry>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="uuid">adf51865-638e-4b5b-a659-48225c878b51</entry>
Oct 25 22:59:58 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 22:59:58 user nova-compute[74507]:     </system>
Oct 25 22:59:58 user nova-compute[74507]:   </sysinfo>
Oct 25 22:59:58 user nova-compute[74507]:   <os>
Oct 25 22:59:58 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 22:59:58 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 22:59:58 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 22:59:58 user nova-compute[74507]:   </os>
Oct 25 22:59:58 user nova-compute[74507]:   <features>
Oct 25 22:59:58 user nova-compute[74507]:     <acpi/>
Oct 25 22:59:58 user nova-compute[74507]:     <apic/>
Oct 25 22:59:58 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 22:59:58 user nova-compute[74507]:   </features>
Oct 25 22:59:58 user nova-compute[74507]:   <clock offset="utc">
Oct 25 22:59:58 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 22:59:58 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 22:59:58 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 22:59:58 user nova-compute[74507]:   </clock>
Oct 25 22:59:58 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 22:59:58 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 22:59:58 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 22:59:58 user nova-compute[74507]:   </cpu>
Oct 25 22:59:58 user nova-compute[74507]:   <devices>
Oct 25 22:59:58 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 22:59:58 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 22:59:58 user nova-compute[74507]:       <source dev="/dev/sdf"/>
Oct 25 22:59:58 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 22:59:58 user nova-compute[74507]:       <serial>f37685f4-49d8-45b7-81ab-575e5f75ad63</serial>
Oct 25 22:59:58 user nova-compute[74507]:     </disk>
Oct 25 22:59:58 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 22:59:58 user nova-compute[74507]:       <mac address="fa:16:3e:a7:ec:48"/>
Oct 25 22:59:58 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:59:58 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 22:59:58 user nova-compute[74507]:       <target dev="tape2cce1f3-6d"/>
Oct 25 22:59:58 user nova-compute[74507]:     </interface>
Oct 25 22:59:58 user nova-compute[74507]:     <serial type="pty">
Oct 25 22:59:58 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/adf51865-638e-4b5b-a659-48225c878b51/console.log" append="off"/>
Oct 25 22:59:58 user nova-compute[74507]:     </serial>
Oct 25 22:59:58 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 22:59:58 user nova-compute[74507]:     <video>
Oct 25 22:59:58 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 22:59:58 user nova-compute[74507]:     </video>
Oct 25 22:59:58 user nova-compute[74507]:     <rng model="virtio">
Oct 25 22:59:58 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 22:59:58 user nova-compute[74507]:     </rng>
Oct 25 22:59:58 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 22:59:58 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 22:59:58 user nova-compute[74507]:       <stats period="10"/>
Oct 25 22:59:58 user nova-compute[74507]:     </memballoon>
Oct 25 22:59:58 user nova-compute[74507]:   </devices>
Oct 25 22:59:58 user nova-compute[74507]: </domain>
Oct 25 22:59:58 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-94842029',display_name='tempest-TestVolumeBootPattern-server-94842029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-94842029',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-4pvoqnn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:30Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=adf51865-638e-4b5b-a659-48225c878b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG os_vif [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e87905f0-a50b-5cc3-8cb0-856acf939d83', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2cce1f3-6d, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2cce1f3-6d, col_values=(('qos', UUID('6bc2fcd1-6ca1-431f-905c-6b42e1d9128d')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2cce1f3-6d, col_values=(('external_ids', {'iface-id': 'e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ec:48', 'vm-uuid': 'adf51865-638e-4b5b-a659-48225c878b51'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:58 user nova-compute[74507]: INFO os_vif [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d')
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 22:59:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:a7:ec:48, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 22:59:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 22:59:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] No waiting events found dispatching network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:00 user nova-compute[74507]: WARNING nova.compute.manager [req-de28eede-3d70-4d3e-a5b0-351c3aca8d8e req-32fc1f14-2e18-42af-b0ec-a89fefb3472a service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received unexpected event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef for instance with vm_state building and task_state spawning.
Oct 25 23:00:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:00:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] Instance spawned successfully.
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:00:02 user nova-compute[74507]: INFO nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Took 5.20 seconds to spawn the instance on the hypervisor.
Oct 25 23:00:02 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:00:02 user nova-compute[74507]: INFO nova.compute.manager [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Took 32.94 seconds to build instance.
Oct 25 23:00:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e28c3f6-5341-4ab8-aa47-63ea937404ea tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.058s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] No waiting events found dispatching network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:02 user nova-compute[74507]: WARNING nova.compute.manager [req-70d6ecc1-160b-4904-a7b7-c4dbe0f21b09 req-c5495f59-0f55-4d81-b4c5-291c108f6f01 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received unexpected event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef for instance with vm_state active and task_state None.
Oct 25 23:00:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Starting finish_migration {{(pid=74507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 23:00:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Creating image(s)
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start _get_guest_xml network_info=[{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd0ca67da-9636-4ce5-838b-03f10eaa55ce', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e', 'attached_at': '2023-10-25T23:00:07.000000', 'detached_at': '', 'volume_id': '87bbdff7-6227-498c-ae83-880aa183b685', 'serial': '87bbdff7-6227-498c-ae83-880aa183b685'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:00:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:07 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccea0f8-50a6-4724-b4c0-af1bf2ef8e99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:00:07 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7670baa6-c7cb-4b64-8725-1d24efc9f623]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685] added
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[288d4a56-b447-4e4b-a5c8-6ccdc24cea41]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[616f1219-2c7d-4069-abd1-7d50c0ac0c64]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ieMhxYmQ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ieMhxYmQ" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38723cba-13b2-4266-addf-9d5f28c9f2f8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ieMhxYmQ'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba779292-0b2e-4c4b-b18f-44eafd6f20db]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c486a-2034-486c-be9d-5c1475cd2ea2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67762112-8e6c-4c0a-9dd6-709a966317ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]
Oct 25 23:00:07 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a315c60-ad43-4667-bb4f-09aa93206073]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b00947e-fbb7-4595-855e-a7e515760aef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ebda9-7c82-467f-802d-2766ef790795]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23066326238626636', 'path': '/dev/sdg'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066326238626636', 'path': '/dev/sdg'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:00:08 user nova-compute[74507]:   <uuid>af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</uuid>
Oct 25 23:00:08 user nova-compute[74507]:   <name>instance-00000019</name>
Oct 25 23:00:08 user nova-compute[74507]:   <memory>2097152</memory>
Oct 25 23:00:08 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:00:08 user nova-compute[74507]:   <metadata>
Oct 25 23:00:08 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:00:08 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:00:08 user nova-compute[74507]:       <nova:name>tempest-ServerActionsTestOtherA-server-1903179898</nova:name>
Oct 25 23:00:08 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:00:07</nova:creationTime>
Oct 25 23:00:08 user nova-compute[74507]:       <nova:flavor name="m1.small">
Oct 25 23:00:08 user nova-compute[74507]:         <nova:memory>2048</nova:memory>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:disk>20</nova:disk>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:00:08 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:00:08 user nova-compute[74507]:       <nova:owner>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:user uuid="40a2834cde90449e8067ae627d799836">tempest-ServerActionsTestOtherA-1402899626-project-member</nova:user>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:project uuid="0bae88be410b4835bd2e0470ed90a895">tempest-ServerActionsTestOtherA-1402899626</nova:project>
Oct 25 23:00:08 user nova-compute[74507]:       </nova:owner>
Oct 25 23:00:08 user nova-compute[74507]:       <nova:ports>
Oct 25 23:00:08 user nova-compute[74507]:         <nova:port uuid="c26964ed-5bb7-4522-9569-b08e7b085ca9">
Oct 25 23:00:08 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 23:00:08 user nova-compute[74507]:         </nova:port>
Oct 25 23:00:08 user nova-compute[74507]:       </nova:ports>
Oct 25 23:00:08 user nova-compute[74507]:     </nova:instance>
Oct 25 23:00:08 user nova-compute[74507]:   </metadata>
Oct 25 23:00:08 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:00:08 user nova-compute[74507]:     <system>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="serial">af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</entry>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="uuid">af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e</entry>
Oct 25 23:00:08 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:00:08 user nova-compute[74507]:     </system>
Oct 25 23:00:08 user nova-compute[74507]:   </sysinfo>
Oct 25 23:00:08 user nova-compute[74507]:   <os>
Oct 25 23:00:08 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:00:08 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:00:08 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:00:08 user nova-compute[74507]:   </os>
Oct 25 23:00:08 user nova-compute[74507]:   <features>
Oct 25 23:00:08 user nova-compute[74507]:     <acpi/>
Oct 25 23:00:08 user nova-compute[74507]:     <apic/>
Oct 25 23:00:08 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:00:08 user nova-compute[74507]:   </features>
Oct 25 23:00:08 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:00:08 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:00:08 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:00:08 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:00:08 user nova-compute[74507]:   </clock>
Oct 25 23:00:08 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:00:08 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:00:08 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:00:08 user nova-compute[74507]:   </cpu>
Oct 25 23:00:08 user nova-compute[74507]:   <devices>
Oct 25 23:00:08 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:00:08 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:08 user nova-compute[74507]:       <source dev="/dev/sdg"/>
Oct 25 23:00:08 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:00:08 user nova-compute[74507]:       <serial>87bbdff7-6227-498c-ae83-880aa183b685</serial>
Oct 25 23:00:08 user nova-compute[74507]:     </disk>
Oct 25 23:00:08 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:00:08 user nova-compute[74507]:       <mac address="fa:16:3e:1b:16:e5"/>
Oct 25 23:00:08 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:00:08 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:00:08 user nova-compute[74507]:       <target dev="tapc26964ed-5b"/>
Oct 25 23:00:08 user nova-compute[74507]:     </interface>
Oct 25 23:00:08 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:00:08 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e/console.log" append="off"/>
Oct 25 23:00:08 user nova-compute[74507]:     </serial>
Oct 25 23:00:08 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:00:08 user nova-compute[74507]:     <video>
Oct 25 23:00:08 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:00:08 user nova-compute[74507]:     </video>
Oct 25 23:00:08 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:00:08 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:00:08 user nova-compute[74507]:     </rng>
Oct 25 23:00:08 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:00:08 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:00:08 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:00:08 user nova-compute[74507]:     </memballoon>
Oct 25 23:00:08 user nova-compute[74507]:   </devices>
Oct 25 23:00:08 user nova-compute[74507]: </domain>
Oct 25 23:00:08 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T22:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1856220504-network", "vif_mac": "fa:16:3e:1b:16:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG os_vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7df75d95-2244-5bbf-9a52-4e8363b9c32f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26964ed-5b, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc26964ed-5b, col_values=(('qos', UUID('e484478d-16be-4dcc-b00e-d1b5b12cb214')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc26964ed-5b, col_values=(('external_ids', {'iface-id': 'c26964ed-5bb7-4522-9569-b08e7b085ca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:16:e5', 'vm-uuid': 'af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:08 user nova-compute[74507]: INFO os_vif [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b')
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:00:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] No VIF found with MAC fa:16:3e:1b:16:e5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:00:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:10 user nova-compute[74507]: WARNING nova.compute.manager [req-90565331-c723-43e7-9cef-711d9a9e2327 req-830a8c39-8e71-49c1-82cd-d0b218f4d673 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state active and task_state resize_finish.
Oct 25 23:00:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:00:12 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance running successfully.
Oct 25 23:00:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Failed to set time: agent not configured {{(pid=74507) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-3bc34efc-bfef-4242-9a2c-ce4a58b527f0 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] finish_migration finished successfully. {{(pid=74507) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:12 user nova-compute[74507]: WARNING nova.compute.manager [req-0b30f36e-923f-4d7d-b113-fc8d5c7ae084 req-c4da1c6a-3b55-4b4e-85de-0b12a8af1bc7 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state active and task_state resize_finish.
Oct 25 23:00:13 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 is timed out.
Oct 25 23:00:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdb from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the live domain config.
Oct 25 23:00:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEbfOCyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e306b1-4d82-4bb6-955f-fd6f535a3010]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:00:13 user nova-compute[74507]: No targets found.
Oct 25 23:00:13 user nova-compute[74507]: iSNS:
Oct 25 23:00:13 user nova-compute[74507]: No targets found.
Oct 25 23:00:13 user nova-compute[74507]: STATIC:
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:00:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:13 user nova-compute[74507]: FIRMWARE:
Oct 25 23:00:13 user nova-compute[74507]: No targets found.
Oct 25 23:00:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:00:13 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:00:13 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30b986-d64f-427a-be27-7ae1d6522f94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd57d29-d86c-4f88-b4ae-1f4a4e94af4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b544d4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77ce76-fb74-47ad-8f60-d65ae76e1355]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e01bea-ffa1-45f5-9687-66f6eba7394e]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4e8403-118e-42b0-8e56-4a54fa991502]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf56e2e-f2dd-4f8a-9140-03780a015281]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098cfcf-29d3-4194-ac3e-9e7281097a83]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3f8e7-d9bf-43c8-bc15-92766148d104]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260]
Oct 25 23:00:13 user nova-compute[74507]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:539b8850-a30c-45f6-a893-7168543a6562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c351c-ed4a-4b8b-89d4-e70f94d56ab6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== disconnect_volume: return (362ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:00:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-12aa2231-3ef0-4db8-ad40-21c520e23f89 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:15 user nova-compute[74507]: INFO nova.compute.manager [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Detaching volume 73bbd954-2b7b-4459-b53e-4166608b3995
Oct 25 23:00:15 user nova-compute[74507]: INFO nova.virt.block_device [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Attempting to driver detach volume 73bbd954-2b7b-4459-b53e-4166608b3995 from mountpoint /dev/vdc
Oct 25 23:00:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Attempting to detach device vdc from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:00:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:00:15 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:15 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:00:15 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:00:15 user nova-compute[74507]:   <serial>73bbd954-2b7b-4459-b53e-4166608b3995</serial>
Oct 25 23:00:15 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 23:00:15 user nova-compute[74507]: </disk>
Oct 25 23:00:15 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:00:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdc from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the persistent domain config.
Oct 25 23:00:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:00:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:00:15 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:15 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:00:15 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:00:15 user nova-compute[74507]:   <serial>73bbd954-2b7b-4459-b53e-4166608b3995</serial>
Oct 25 23:00:15 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 23:00:15 user nova-compute[74507]: </disk>
Oct 25 23:00:15 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:00:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:00:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing instance network info cache due to event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:00:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:19 user nova-compute[74507]: DEBUG nova.network.neutron [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.network.neutron [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updated VIF entry in instance network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.network.neutron [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-51d647b8-092f-4e05-b1a8-bdb5a89b2a6e req-e009110c-c631-44a2-b150-4be065cb9c90 service nova] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:20 user nova-compute[74507]: INFO nova.compute.manager [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Detaching volume bc058bf1-3035-4490-80b9-c6c8313c6c04
Oct 25 23:00:20 user nova-compute[74507]: INFO nova.virt.block_device [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Attempting to driver detach volume bc058bf1-3035-4490-80b9-c6c8313c6c04 from mountpoint /dev/vdb
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Attempting to detach device vdb from instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:00:20 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:20 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:00:20 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:00:20 user nova-compute[74507]:   <serial>bc058bf1-3035-4490-80b9-c6c8313c6c04</serial>
Oct 25 23:00:20 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:00:20 user nova-compute[74507]: </disk>
Oct 25 23:00:20 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:00:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully detached device vdb from instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e from the persistent domain config.
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:00:20 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:20 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:00:20 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:00:20 user nova-compute[74507]:   <serial>bc058bf1-3035-4490-80b9-c6c8313c6c04</serial>
Oct 25 23:00:20 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:00:20 user nova-compute[74507]: </disk>
Oct 25 23:00:20 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:00:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing instance network info cache due to event network-changed-cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] Acquiring lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] Acquired lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Refreshing network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updated VIF entry in instance network info cache for port cf6f3743-2f78-43f1-871c-e88929de8281. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [{"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-85e61384-3c48-4962-a586-52327b25e34c req-4a8b57c8-c10f-41b4-809f-7c975aeed7cd service nova] Releasing lock "refresh_cache-2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:22 user nova-compute[74507]: INFO nova.compute.manager [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Attaching volume 75a62920-e57c-4ca4-83a3-7c1a404a6dab to /dev/vdb
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.utils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b29ff-845e-4c68-a5f2-ebc51c8d136c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbd6088-05ba-4b08-af3a-8c170e2637dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3014de19-6efb-4ab2-a18d-5d65db4802fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08e2ed-a9f8-4202-bb18-0370b466eaa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:00:22 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:00:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c401fee-594e-42c1-8fb2-5c96c2db62ae]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG os_brick.utils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:22 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating existing volume attachment record: 98e8d965-63a8-41ae-9d91-43a09f29b80d {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:00:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:32 user nova-compute[74507]: INFO nova.compute.manager [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Unshelving
Oct 25 23:00:32 user nova-compute[74507]: INFO nova.virt.block_device [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Booting with volume d9119d77-a692-49bb-9d37-5f0043360127 at /dev/vdc
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.utils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92e55e7-d2f9-4034-8339-6f08aebfab99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[974da61a-0e98-47d5-a0ee-a67924ad5134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6607afe0-bc2d-47ae-be2f-9c526c36d6ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[32883763-8fdf-4898-ae95-e54b66cbc67b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:00:32 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:00:32 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32a730-b755-4b5e-9a18-3e6f30b9ca0c]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG os_brick.utils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:32 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating existing volume attachment record: 30e0737d-3e1d-4f8c-b547-b39566eff9dd {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:00:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:34 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:35 user nova-compute[74507]: INFO nova.compute.manager [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Unrescuing
Oct 25 23:00:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:00:35 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.objects.instance [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'flavor' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:36 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 is timed out.
Oct 25 23:00:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully detached device vdc from instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 from the live domain config.
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RBKOYcEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:36 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a0bf39-610e-416d-a5fb-f5d47f8690ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:00:36 user nova-compute[74507]: No targets found.
Oct 25 23:00:36 user nova-compute[74507]: iSNS:
Oct 25 23:00:36 user nova-compute[74507]: No targets found.
Oct 25 23:00:36 user nova-compute[74507]: STATIC:
Oct 25 23:00:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63
Oct 25 23:00:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995
Oct 25 23:00:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:00:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04
Oct 25 23:00:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:36 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:00:36 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:36 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:36 user nova-compute[74507]: FIRMWARE:
Oct 25 23:00:36 user nova-compute[74507]: No targets found.
Oct 25 23:00:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:00:36 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:00:36 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e44676-53dd-480e-93f2-e65c88bc1552]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6336af2-e145-45b9-9958-ccc89b70b70c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c443f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcd032-85cb-42fe-bd14-93e0f26d1699]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a5e69-9d2f-4cb1-8ddb-dddf40d1bc16]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[385cd2a2-c78b-4651-b4d0-267c81307d6f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2074755f-586d-4f23-b4d9-11a203543ac7]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:36 user nova-compute[74507]: WARNING nova.compute.manager [req-f2286b10-1cfd-4a51-aefe-b776630ed125 req-bd488b1f-4c57-4af9-982b-913fcc0a6ee9 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a2cfa8-e129-4b18-954a-113952ce7d9e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19fed26-c6a0-4b52-ba80-508574bb5e1e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260]
Oct 25 23:00:36 user nova-compute[74507]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:36 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73bbd954-2b7b-4459-b53e-4166608b3995 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc12bf8-ed38-4ad8-849c-a1b706ccf2da]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] <== disconnect_volume: return (381ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:00:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance destroyed successfully.
Oct 25 23:00:37 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [{"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-85b692bd-0a00-4dd1-9ce1-cfc0e077818f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:38 user nova-compute[74507]: WARNING nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:00:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:38 user nova-compute[74507]: WARNING nova.compute.manager [req-a593f9bb-756e-4861-84fd-f3f0acc92824 req-2f144aa2-af9a-497d-bd87-0afe300bda00 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:00:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:00:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3f9eb902-1e2c-4a7f-a821-9b3b0665b90f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:40 user nova-compute[74507]: WARNING nova.compute.manager [req-fd131c52-5a33-4942-b7b4-59b204c4aa97 req-1bcb6d30-0696-4917-91b0-ecf6ecfbdf8e service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state active and task_state None.
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e is timed out.
Oct 25 23:00:40 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully detached device vdb from instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e from the live domain config.
Oct 25 23:00:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:00:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJusDfpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:40 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09518404-ab41-4a3d-a5a4-aa3d0033048a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:00:41 user nova-compute[74507]: No targets found.
Oct 25 23:00:41 user nova-compute[74507]: iSNS:
Oct 25 23:00:41 user nova-compute[74507]: No targets found.
Oct 25 23:00:41 user nova-compute[74507]: STATIC:
Oct 25 23:00:41 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63
Oct 25 23:00:41 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:41 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:41 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:00:41 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:41 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:41 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04
Oct 25 23:00:41 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:41 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:41 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:00:41 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:00:41 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:00:41 user nova-compute[74507]: FIRMWARE:
Oct 25 23:00:41 user nova-compute[74507]: No targets found.
Oct 25 23:00:41 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:00:41 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:00:41 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d099a09-8933-46ad-8522-0377bca4fe74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f723e-15c3-4320-b042-165932cb7283]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:41 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b544905e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3221734-2c8c-4c43-b0ff-e1e3c0a26196]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[517261e7-b9dd-4832-9579-890e236991b1]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81fe330-f78a-458c-aa05-c158a4b61430]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1febb5-3f6f-4886-b80b-52b1d8bc73ae]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb465a-5517-4d4c-b51c-0247ad442204]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c1515e-4a83-42fb-9c2b-edbb8cc958e4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260]
Oct 25 23:00:41 user nova-compute[74507]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:41 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc058bf1-3035-4490-80b9-c6c8313c6c04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f071cb-6bab-411b-9b46-ff572d158374]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] <== disconnect_volume: return (378ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=24.93777084350586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Applying migration context for instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e as it has an incoming, in-progress migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2. Migration status is finished {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 23:00:43 user nova-compute[74507]: INFO nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating resource usage from migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance adf51865-638e-4b5b-a659-48225c878b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:00:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'flavor' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6e227455-e665-4160-ae7e-f879c503d8cf tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.593s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:44 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:44 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:44 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8adc3ce-2355-452c-8847-384012d02ddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:00:44 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e11673-91a3-4d83-b975-996af2c359c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab] added
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b715448-3ca0-4d85-a9d4-6be6606a13b3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48a6c1-06b4-4fe5-9674-e3020a4a79c8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYHOIgG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYHOIgG" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa263d9-a6fa-41db-8a2a-9633b47cbca1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnYHOIgG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b0dfa-6cdd-4a45-bfbf-bc7e35fef410]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd01a79-cf1d-4696-bfbb-fa90b4cc4c55]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d090e38-29ff-4b9d-bf21-4cf1dc79918c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]
Oct 25 23:00:44 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f88d0-e639-47bc-a902-0c0fed32dfa6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e116462-8e14-49f4-94be-7bf956844577]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:44 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44564196-00e5-4c77-8802-8f1347e4a70a]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:44 user nova-compute[74507]: INFO nova.compute.manager [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Terminating instance
Oct 25 23:00:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-unplugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] No waiting events found dispatching network-vif-unplugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-b470bc5c-d6f6-4622-a1bd-4bcd1b0ee3ce req-936e8b75-da91-4eff-9d1b-ec9be1213341 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-unplugged-f0102a28-943c-468a-95ee-b6d38224147e for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:00:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Instance destroyed successfully.
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lazy-loading 'resources' on Instance uuid 95222a21-d30d-4541-ad93-2bf6ec9eb7f2 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23836653361396464', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836653361396464', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-315354283',display_name='tempest-AttachVolumeTestJSON-server-315354283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-315354283',id=24,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7clR2Cu4h9TSLxy9KrXUNYwfXNDuD4cUBIZwgTiESVgTRKi4XjVIxiBZWi0C/u28rRQRqpEouxOrIhwVHREZolxj/gMLyokbvW6tG4wOZ4e9/WgSPFmGlNDoExI3h1gQ==',key_name='tempest-keypair-1575894462',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:57:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a9cb2b4089144f4b19cd0a3cba46a8e',ramdisk_id='',reservation_id='r-fe4xm9y2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1587183484',owner_user_name='tempest-AttachVolumeTestJSON-1587183484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab99f645064dacb32c07b5beae3f8f',uuid=95222a21-d30d-4541-ad93-2bf6ec9eb7f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converting VIF {"id": "f0102a28-943c-468a-95ee-b6d38224147e", "address": "fa:16:3e:e6:6e:89", "network": {"id": "48780122-f120-4ff9-8eb1-a43e1af4f240", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-322781238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a9cb2b4089144f4b19cd0a3cba46a8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0102a28-94", "ovs_interfaceid": "f0102a28-943c-468a-95ee-b6d38224147e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG os_vif [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0102a28-94, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6852cc70-57ba-4b1a-9c78-eb4d695a5f83) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:45 user nova-compute[74507]: INFO os_vif [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6e:89,bridge_name='br-int',has_traffic_filtering=True,id=f0102a28-943c-468a-95ee-b6d38224147e,network=Network(48780122-f120-4ff9-8eb1-a43e1af4f240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0102a28-94')
Oct 25 23:00:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Deleting instance files /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2_del
Oct 25 23:00:45 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Deletion of /opt/stack/data/nova/instances/95222a21-d30d-4541-ad93-2bf6ec9eb7f2_del complete
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:00:45 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:00:45 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:00:45 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:00:45 user nova-compute[74507]:   <serial>75a62920-e57c-4ca4-83a3-7c1a404a6dab</serial>
Oct 25 23:00:45 user nova-compute[74507]: </disk>
Oct 25 23:00:45 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:00:45 user nova-compute[74507]: INFO nova.compute.manager [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 23:00:45 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:00:45 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No VIF found with MAC fa:16:3e:e3:3b:9f, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-86d9ea1e-c752-4a00-a7c4-7693d4ded914 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.483s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:46 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Took 0.74 seconds to deallocate network for instance.
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-16d4184d-e62b-4df3-8931-735d7c58e4ea req-f303739c-eaed-457d-940b-0b9adff5a0f9 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-deleted-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:00:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:46 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Deleted allocations for instance 95222a21-d30d-4541-ad93-2bf6ec9eb7f2
Oct 25 23:00:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-d6902e31-ec5d-4696-a259-f55d07d5b765 tempest-AttachVolumeTestJSON-1587183484 tempest-AttachVolumeTestJSON-1587183484-project-member] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] Acquiring lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] Lock "95222a21-d30d-4541-ad93-2bf6ec9eb7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] No waiting events found dispatching network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:00:47 user nova-compute[74507]: WARNING nova.compute.manager [req-5a8d2968-56bc-4b99-b464-e5f4124557e2 req-037f1082-c7be-42ca-ade7-fd5848bc7df4 service nova] [instance: 95222a21-d30d-4541-ad93-2bf6ec9eb7f2] Received unexpected event network-vif-plugged-f0102a28-943c-468a-95ee-b6d38224147e for instance with vm_state deleted and task_state None.
Oct 25 23:00:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_requests' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'numa_topology' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:00:52 user nova-compute[74507]: INFO nova.compute.claims [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Claim successful on node user
Oct 25 23:00:52 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:00:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:52 user nova-compute[74507]: INFO nova.network.neutron [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing instance network info cache due to event network-changed-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] Acquiring lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:00:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Creating image(s)
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'trusted_certs' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] Acquired lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.network.neutron [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Refreshing network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG nova.objects.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<c59e7e75-ee1c-4751-8ef2-b46f80c9d907> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "3c38052184856dcc4bb0874effb59cffe4db8442" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "3c38052184856dcc4bb0874effb59cffe4db8442" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'flavor' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ef7282a9-7631-4a52-b419-77e944209a75 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.818s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG nova.virt.images [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] e310bba2-9e18-4010-b434-671a5ed3dab3 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.part /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG nova.network.neutron [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updated VIF entry in instance network info cache for port 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG nova.network.neutron [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-06945298-508b-4a0c-bfa4-264a56d70018 req-d00b4b2e-16f1-4c28-a60d-bababdf0a94c service nova] Releasing lock "refresh_cache-c59e7e75-ee1c-4751-8ef2-b46f80c9d907" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.part /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.converted" returned: 0 in 0.442s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "3c38052184856dcc4bb0874effb59cffe4db8442" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.028s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "3c38052184856dcc4bb0874effb59cffe4db8442" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "3c38052184856dcc4bb0874effb59cffe4db8442" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442,backing_fmt=raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442,backing_fmt=raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk 1073741824" returned: 0 in 0.057s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "3c38052184856dcc4bb0874effb59cffe4db8442" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'migration_context' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG nova.objects.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<c59e7e75-ee1c-4751-8ef2-b46f80c9d907> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:00:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Rebasing disk image.
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab -F raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab -F raw /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk" returned: 0 in 2.020s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Ensure instance console log exists: /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start _get_guest_xml network_info=[{"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='518d63ab5b94383405d4f0c62be10ba1',container_format='bare',created_at=2023-10-25T22:58:39Z,direct_url=<?>,disk_format='qcow2',id=e310bba2-9e18-4010-b434-671a5ed3dab3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1689378523-shelved',owner='efbf59e935fe4170b38670efe09764dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T22:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '30e0737d-3e1d-4f8c-b547-b39566eff9dd', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcMTdKgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c59e7e75-ee1c-4751-8ef2-b46f80c9d907', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9119d77-a692-49bb-9d37-5f0043360127', 'serial': 'd9119d77-a692-49bb-9d37-5f0043360127'}, 'boot_index': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:00:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='518d63ab5b94383405d4f0c62be10ba1',container_format='bare',created_at=2023-10-25T22:58:39Z,direct_url=<?>,disk_format='qcow2',id=e310bba2-9e18-4010-b434-671a5ed3dab3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1689378523-shelved',owner='efbf59e935fe4170b38670efe09764dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T22:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'vcpu_model' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.objects.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<c59e7e75-ee1c-4751-8ef2-b46f80c9d907> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcMTdKgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:00:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:58 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:00:58 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f09a9da-0a53-443a-b2b5-7b538487ec02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:00:58 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2f9a9-038e-402b-a3e8-36f5ed853034]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127] added
Oct 25 23:00:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfd53c1-1b38-4668-9ae0-9acd9a589413]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0085f7f-828b-4589-8667-bb5451916d26]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcMTdKgp {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcMTdKgp" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fd33db-1d44-41f4-a99f-dc29d1e3f6d9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcMTdKgp'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f9b4f-e32b-48df-ac0a-775a4d2cc34b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005122f-7797-40a8-9b4b-26c0d45ea82f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:59 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:59 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing instance network info cache due to event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25a01c0-ac14-4228-bc31-c6ec48f3e4f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260]
Oct 25 23:00:59 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260] successful.
Oct 25 23:00:59 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.120s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e710d6a-3ba3-49de-b6bb-fb731452f038]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6aadc7-5bfd-4280-919e-06cf33d8ada5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:00:59 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:00:59 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd2049-1d3e-4c94-aa44-0ae54829bf79]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcMTdKgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updated VIF entry in instance network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:00:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9f738b6c-8340-47e4-a003-8c2a07d3c180 req-763f23d9-5491-4918-b5d8-264639c1f898 service nova] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.545s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] <== connect_volume: return (1547ms) {'type': 'block', 'scsi_wwn': '26634623763353332', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634623763353332', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='e310bba2-9e18-4010-b434-671a5ed3dab3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-383944364',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T22:58:46.230770',shelved_host='user',shelved_image_id='e310bba2-9e18-4010-b434-671a5ed3dab3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_devices' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.objects.base [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<c59e7e75-ee1c-4751-8ef2-b46f80c9d907> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:01:00 user nova-compute[74507]:   <uuid>c59e7e75-ee1c-4751-8ef2-b46f80c9d907</uuid>
Oct 25 23:01:00 user nova-compute[74507]:   <name>instance-00000016</name>
Oct 25 23:01:00 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:01:00 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:01:00 user nova-compute[74507]:   <metadata>
Oct 25 23:01:00 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:01:00 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1689378523</nova:name>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:00:58</nova:creationTime>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:01:00 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:01:00 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:owner>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:user uuid="b81defc8e43843d3b14cc249f9e7dd73">tempest-AttachVolumeShelveTestJSON-2059391716-project-member</nova:user>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:project uuid="efbf59e935fe4170b38670efe09764dc">tempest-AttachVolumeShelveTestJSON-2059391716</nova:project>
Oct 25 23:01:00 user nova-compute[74507]:       </nova:owner>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:root type="image" uuid="e310bba2-9e18-4010-b434-671a5ed3dab3"/>
Oct 25 23:01:00 user nova-compute[74507]:       <nova:ports>
Oct 25 23:01:00 user nova-compute[74507]:         <nova:port uuid="9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5">
Oct 25 23:01:00 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 23:01:00 user nova-compute[74507]:         </nova:port>
Oct 25 23:01:00 user nova-compute[74507]:       </nova:ports>
Oct 25 23:01:00 user nova-compute[74507]:     </nova:instance>
Oct 25 23:01:00 user nova-compute[74507]:   </metadata>
Oct 25 23:01:00 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:01:00 user nova-compute[74507]:     <system>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="serial">c59e7e75-ee1c-4751-8ef2-b46f80c9d907</entry>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="uuid">c59e7e75-ee1c-4751-8ef2-b46f80c9d907</entry>
Oct 25 23:01:00 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:01:00 user nova-compute[74507]:     </system>
Oct 25 23:01:00 user nova-compute[74507]:   </sysinfo>
Oct 25 23:01:00 user nova-compute[74507]:   <os>
Oct 25 23:01:00 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:01:00 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:01:00 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:01:00 user nova-compute[74507]:   </os>
Oct 25 23:01:00 user nova-compute[74507]:   <features>
Oct 25 23:01:00 user nova-compute[74507]:     <acpi/>
Oct 25 23:01:00 user nova-compute[74507]:     <apic/>
Oct 25 23:01:00 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:01:00 user nova-compute[74507]:   </features>
Oct 25 23:01:00 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:01:00 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:01:00 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:01:00 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:01:00 user nova-compute[74507]:   </clock>
Oct 25 23:01:00 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:01:00 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:01:00 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:01:00 user nova-compute[74507]:   </cpu>
Oct 25 23:01:00 user nova-compute[74507]:   <devices>
Oct 25 23:01:00 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:01:00 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:01:00 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk"/>
Oct 25 23:01:00 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:01:00 user nova-compute[74507]:     </disk>
Oct 25 23:01:00 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:01:00 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:01:00 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 23:01:00 user nova-compute[74507]:       <target dev="vdc" bus="virtio"/>
Oct 25 23:01:00 user nova-compute[74507]:       <serial>d9119d77-a692-49bb-9d37-5f0043360127</serial>
Oct 25 23:01:00 user nova-compute[74507]:     </disk>
Oct 25 23:01:00 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:01:00 user nova-compute[74507]:       <mac address="fa:16:3e:21:93:f4"/>
Oct 25 23:01:00 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:01:00 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:01:00 user nova-compute[74507]:       <target dev="tap9cb8c7f9-45"/>
Oct 25 23:01:00 user nova-compute[74507]:     </interface>
Oct 25 23:01:00 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:01:00 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/console.log" append="off"/>
Oct 25 23:01:00 user nova-compute[74507]:     </serial>
Oct 25 23:01:00 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:01:00 user nova-compute[74507]:     <video>
Oct 25 23:01:00 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:01:00 user nova-compute[74507]:     </video>
Oct 25 23:01:00 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:01:00 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:01:00 user nova-compute[74507]:     </rng>
Oct 25 23:01:00 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:01:00 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:01:00 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:01:00 user nova-compute[74507]:     </memballoon>
Oct 25 23:01:00 user nova-compute[74507]:   </devices>
Oct 25 23:01:00 user nova-compute[74507]: </domain>
Oct 25 23:01:00 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='e310bba2-9e18-4010-b434-671a5ed3dab3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-383944364',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T22:58:46.230770',shelved_host='user',shelved_image_id='e310bba2-9e18-4010-b434-671a5ed3dab3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG os_vif [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '058ea52b-acb4-52b5-88cb-aec6ea1c6ea2', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cb8c7f9-45, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cb8c7f9-45, col_values=(('qos', UUID('b178b386-e66f-4e4b-a318-2cbe0d814496')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cb8c7f9-45, col_values=(('external_ids', {'iface-id': '9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:93:f4', 'vm-uuid': 'c59e7e75-ee1c-4751-8ef2-b46f80c9d907'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:00 user nova-compute[74507]: INFO os_vif [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45')
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:01:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No VIF found with MAC fa:16:3e:21:93:f4, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing instance network info cache due to event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:01:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updated VIF entry in instance network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f6c1ea9-b4bf-4dd6-b1e0-9a0f116d4bae req-80379667-4ac5-4d0e-960d-a1fbdaa6f126 service nova] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:02 user nova-compute[74507]: WARNING nova.compute.manager [req-f1afdbc0-014d-4682-9670-3f343f897623 req-c55ea969-b833-4c4b-a5be-b7b26e5e2255 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:01:04 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance spawned successfully.
Oct 25 23:01:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG nova.compute.manager [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:04 user nova-compute[74507]: WARNING nova.compute.manager [req-935308b1-881b-4ecc-a9d1-532f2dd52a0d req-9387995b-41aa-4f18-9b07-83146e1f8fc5 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:01:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:01:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6572d2d8-1d03-4e8f-b4fd-5b54f6391e55 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.061s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:10 user nova-compute[74507]: INFO nova.compute.manager [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Terminating instance
Oct 25 23:01:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-56f942aa-23d4-4927-8bb6-1aa025e38575 req-5075cf52-e91c-4264-aa1b-b64adf11952e service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-unplugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Instance destroyed successfully.
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:54:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1958550715',display_name='tempest-ServerRescueNegativeTestJSON-server-1958550715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1958550715',id=21,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIY85996ZqLbqvshNzZSsujgnp/ztI7GN/hGUjYO3U8dGZLWF3nCBiUPa3CVpbxDKtdqHED8YGvMJvNmTJjKFztx7lAeaOksc5O+gpQy8hYynSJ3Yr6OFji5b7rKkM//A==',key_name='tempest-keypair-855081839',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-xwfxqu5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4427778755994cca9d47b515e4aed8ea',uuid=2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "cf6f3743-2f78-43f1-871c-e88929de8281", "address": "fa:16:3e:d8:5f:c8", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f3743-2f", "ovs_interfaceid": "cf6f3743-2f78-43f1-871c-e88929de8281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG os_vif [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf6f3743-2f, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=740efadc-14c9-45f0-af7f-059421b36f4a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:11 user nova-compute[74507]: INFO os_vif [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5f:c8,bridge_name='br-int',has_traffic_filtering=True,id=cf6f3743-2f78-43f1-871c-e88929de8281,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f3743-2f')
Oct 25 23:01:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Deleting instance files /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e_del
Oct 25 23:01:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Deletion of /opt/stack/data/nova/instances/2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e_del complete
Oct 25 23:01:11 user nova-compute[74507]: INFO nova.compute.manager [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 23:01:11 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:01:11 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:12 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Took 0.73 seconds to deallocate network for instance.
Oct 25 23:01:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-208522aa-91cc-4b7d-989f-ddb12b9f3d9e req-6a8b7bfc-b699-44fd-a448-aa81f5c88c73 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-deleted-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:01:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:12 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Deleted allocations for instance 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:13 user nova-compute[74507]: INFO nova.compute.manager [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Rebooting instance
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7c61db2e-17b2-4312-9a55-1c329e46d227 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.206s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] Acquiring lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] Lock "2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] No waiting events found dispatching network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:13 user nova-compute[74507]: WARNING nova.compute.manager [req-e1c4d2ae-0eee-42a8-895f-38ef2dfbd1b3 req-1b4c8900-4142-4b73-b2c8-d5a66b8c41e7 service nova] [instance: 2a9bea03-2f29-48c7-89b4-2cd89b6f6f3e] Received unexpected event network-vif-plugged-cf6f3743-2f78-43f1-871c-e88929de8281 for instance with vm_state deleted and task_state None.
Oct 25 23:01:13 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance destroyed successfully.
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'resources' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:01:14Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dad3624-c2, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=792ef771-02a5-4837-9319-a638004ea6d9) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:14 user nova-compute[74507]: INFO os_vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2')
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88f681-dbec-4833-ad19-06baff96d59a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:01:14 user nova-compute[74507]: No targets found.
Oct 25 23:01:14 user nova-compute[74507]: iSNS:
Oct 25 23:01:14 user nova-compute[74507]: No targets found.
Oct 25 23:01:14 user nova-compute[74507]: STATIC:
Oct 25 23:01:14 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63
Oct 25 23:01:14 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:14 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:14 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:01:14 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:14 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:14 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127
Oct 25 23:01:14 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:14 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:14 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab
Oct 25 23:01:14 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:14 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:14 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:01:14 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:14 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:14 user nova-compute[74507]: FIRMWARE:
Oct 25 23:01:14 user nova-compute[74507]: No targets found.
Oct 25 23:01:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:01:14 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:01:14 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f2f6a4-3d5c-43df-a15e-9f0cff231aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c85c6-1e0b-48a0-a3b0-2a7df89ac23d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:14 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5465bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING nova.compute.manager [req-f5a3eba0-21f8-4182-8946-cd51a3e196c7 req-d1e08bf2-e4eb-45fe-94f9-ee88a708192a service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ff015-4870-4c56-b51d-01edbd79687b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e53356-e653-4c78-9bf5-316bbba8ec8d]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab81baf-e147-401d-a6e1-54696b650002]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6094e-8e6a-42bf-bd21-b77fdddf4fb2]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c10829-29aa-4164-bb94-de7b5ac7997f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d66f8a-d9dc-4b72-839c-9556766849e2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]
Oct 25 23:01:14 user nova-compute[74507]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.
Oct 25 23:01:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[844b7dda-7f0e-454a-a5dd-d807f9ce4f3d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== disconnect_volume: return (335ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start _get_guest_xml network_info=[{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2f80a88e-f2c3-4a17-bfb9-14f22ebf231d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '2f80a88e-f2c3-4a17-bfb9-14f22ebf231d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98e8d965-63a8-41ae-9d91-43a09f29b80d', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '96c4f0c8-0ed6-413b-9c85-3327c0317a19', 'attached_at': '', 'detached_at': '', 'volume_id': '75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'serial': '75a62920-e57c-4ca4-83a3-7c1a404a6dab'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:01:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2f80a88e-f2c3-4a17-bfb9-14f22ebf231d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.objects.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Object Instance<96c4f0c8-0ed6-413b-9c85-3327c0317a19> lazy-loaded attributes: resources,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:01:14 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:01:14 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3a3d9-f6a8-4c50-81b6-a4aa9d50fd0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:01:14 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb296b-a754-4300-bde8-e0410427d871]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab] added
Oct 25 23:01:14 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff73a2-b734-4c2e-b107-a9ca2f3a480d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa17876a-b391-4c08-b435-568828ff3671]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYHOIgG {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYHOIgG" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe77d29-654d-4edd-b307-4ec21ff1f78b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnYHOIgG'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad00e2-c0fe-4722-970f-65a222b2a4a8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb929e2-a174-4fd7-8946-254dc3e400db]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4806299-1809-4bfc-8370-879471bcb1d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]
Oct 25 23:01:15 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.
Oct 25 23:01:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d938a7-aef5-4778-8dea-7787a651aec1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f2c7e-3189-465c-9e6a-c5fb0532e7ab]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a0ca6-5afa-4be5-b305-66d16651d5af]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:01:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23836653361396464', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836653361396464', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:01:14Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.objects.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Object Instance<96c4f0c8-0ed6-413b-9c85-3327c0317a19> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:01:16 user nova-compute[74507]:   <uuid>96c4f0c8-0ed6-413b-9c85-3327c0317a19</uuid>
Oct 25 23:01:16 user nova-compute[74507]:   <name>instance-0000001a</name>
Oct 25 23:01:16 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:01:16 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:01:16 user nova-compute[74507]:   <metadata>
Oct 25 23:01:16 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:01:16 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:name>tempest-TestMinimumBasicScenario-server-1757322610</nova:name>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:01:14</nova:creationTime>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:01:16 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:01:16 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:owner>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:user uuid="a2bd439fd8ec46f89ab4dba1021525d2">tempest-TestMinimumBasicScenario-1674517596-project-member</nova:user>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:project uuid="9eb3fed6110e44d6ba6922cf016d07e8">tempest-TestMinimumBasicScenario-1674517596</nova:project>
Oct 25 23:01:16 user nova-compute[74507]:       </nova:owner>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:root type="image" uuid="2f80a88e-f2c3-4a17-bfb9-14f22ebf231d"/>
Oct 25 23:01:16 user nova-compute[74507]:       <nova:ports>
Oct 25 23:01:16 user nova-compute[74507]:         <nova:port uuid="2dad3624-c2f3-4ff5-bad3-e755c3204a39">
Oct 25 23:01:16 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 23:01:16 user nova-compute[74507]:         </nova:port>
Oct 25 23:01:16 user nova-compute[74507]:       </nova:ports>
Oct 25 23:01:16 user nova-compute[74507]:     </nova:instance>
Oct 25 23:01:16 user nova-compute[74507]:   </metadata>
Oct 25 23:01:16 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:01:16 user nova-compute[74507]:     <system>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="serial">96c4f0c8-0ed6-413b-9c85-3327c0317a19</entry>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="uuid">96c4f0c8-0ed6-413b-9c85-3327c0317a19</entry>
Oct 25 23:01:16 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:01:16 user nova-compute[74507]:     </system>
Oct 25 23:01:16 user nova-compute[74507]:   </sysinfo>
Oct 25 23:01:16 user nova-compute[74507]:   <os>
Oct 25 23:01:16 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:01:16 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:01:16 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:01:16 user nova-compute[74507]:   </os>
Oct 25 23:01:16 user nova-compute[74507]:   <features>
Oct 25 23:01:16 user nova-compute[74507]:     <acpi/>
Oct 25 23:01:16 user nova-compute[74507]:     <apic/>
Oct 25 23:01:16 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:01:16 user nova-compute[74507]:   </features>
Oct 25 23:01:16 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:01:16 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:01:16 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:01:16 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:01:16 user nova-compute[74507]:   </clock>
Oct 25 23:01:16 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:01:16 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:01:16 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:01:16 user nova-compute[74507]:   </cpu>
Oct 25 23:01:16 user nova-compute[74507]:   <devices>
Oct 25 23:01:16 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:01:16 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:01:16 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk"/>
Oct 25 23:01:16 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:01:16 user nova-compute[74507]:     </disk>
Oct 25 23:01:16 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:01:16 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:01:16 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 23:01:16 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 23:01:16 user nova-compute[74507]:       <serial>75a62920-e57c-4ca4-83a3-7c1a404a6dab</serial>
Oct 25 23:01:16 user nova-compute[74507]:     </disk>
Oct 25 23:01:16 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:01:16 user nova-compute[74507]:       <mac address="fa:16:3e:e3:3b:9f"/>
Oct 25 23:01:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:01:16 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:01:16 user nova-compute[74507]:       <target dev="tap2dad3624-c2"/>
Oct 25 23:01:16 user nova-compute[74507]:     </interface>
Oct 25 23:01:16 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:01:16 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/console.log" append="off"/>
Oct 25 23:01:16 user nova-compute[74507]:     </serial>
Oct 25 23:01:16 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:01:16 user nova-compute[74507]:     <video>
Oct 25 23:01:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:01:16 user nova-compute[74507]:     </video>
Oct 25 23:01:16 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:01:16 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:01:16 user nova-compute[74507]:     </rng>
Oct 25 23:01:16 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:01:16 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:01:16 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:01:16 user nova-compute[74507]:     </memballoon>
Oct 25 23:01:16 user nova-compute[74507]:   </devices>
Oct 25 23:01:16 user nova-compute[74507]: </domain>
Oct 25 23:01:16 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'trusted_certs' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.objects.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Object Instance<96c4f0c8-0ed6-413b-9c85-3327c0317a19> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622 --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:01:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Cannot resize image /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'migration_context' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.objects.base [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Object Instance<96c4f0c8-0ed6-413b-9c85-3327c0317a19> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:01:14Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG os_vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8898548b-5d53-5da5-bf31-16f538abf30f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dad3624-c2, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dad3624-c2, col_values=(('qos', UUID('7cda6da9-5a98-46d3-ac02-a77a1d8c4712')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dad3624-c2, col_values=(('external_ids', {'iface-id': '2dad3624-c2f3-4ff5-bad3-e755c3204a39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:3b:9f', 'vm-uuid': '96c4f0c8-0ed6-413b-9c85-3327c0317a19'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:17 user nova-compute[74507]: INFO os_vif [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2')
Oct 25 23:01:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:18 user nova-compute[74507]: WARNING nova.compute.manager [req-fde544c7-5171-4490-917e-1c3893660c2e req-05aa8d01-1c6a-41e7-be58-fae12f858f28 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:19 user nova-compute[74507]: INFO nova.compute.manager [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Terminating instance
Oct 25 23:01:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] Instance destroyed successfully.
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid adf51865-638e-4b5b-a659-48225c878b51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-94842029',display_name='tempest-TestVolumeBootPattern-server-94842029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-94842029',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-4pvoqnn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:00:02Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=adf51865-638e-4b5b-a659-48225c878b51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "address": "fa:16:3e:a7:ec:48", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2cce1f3-6d", "ovs_interfaceid": "e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_vif [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2cce1f3-6d, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bc2fcd1-6ca1-431f-905c-6b42e1d9128d) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:01:20 user nova-compute[74507]: INFO os_vif [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ec:48,bridge_name='br-int',has_traffic_filtering=True,id=e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2cce1f3-6d')
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUhOcELA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:01:20 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820f929-4db3-4489-9174-f84fdfbb9218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:01:20 user nova-compute[74507]: No targets found.
Oct 25 23:01:20 user nova-compute[74507]: iSNS:
Oct 25 23:01:20 user nova-compute[74507]: No targets found.
Oct 25 23:01:20 user nova-compute[74507]: STATIC:
Oct 25 23:01:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63
Oct 25 23:01:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:01:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127
Oct 25 23:01:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab
Oct 25 23:01:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:01:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:01:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:01:20 user nova-compute[74507]: FIRMWARE:
Oct 25 23:01:20 user nova-compute[74507]: No targets found.
Oct 25 23:01:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:01:20 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:01:20 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9136577-354b-4af3-83eb-33a1ffdd4bf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37310d-2e3f-498b-aec6-864a612f095d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:01:20 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:01:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6420eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63'): ({'sdf'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdf {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236a53b-7a36-424c-895e-45ff5b1f7568]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7351f2a4-eabd-4de3-a1cd-1c649468a97b]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdf {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ad979-8e5f-48a9-bae2-840b877836c8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.078s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5123d722-7d79-4413-9c8a-553370d56b34]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23630396138663832', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5ba47b6d', '/dev/disk/by-id/scsi-1SCST_BIO5ba47b6d-609a8f829dd39a12') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd13f72-d34f-4817-9d56-af7833f7a22f]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ce92af-fd96-4544-8cb0-f733ea46181c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c6082-1197-4667-97df-e27c2f2ebf21]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260]
Oct 25 23:01:20 user nova-compute[74507]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63, portal: 172.16.0.220,3260] successful.
Oct 25 23:01:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:01:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance rebooted successfully.
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:20 user nova-compute[74507]: WARNING nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-unplugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] No waiting events found dispatching network-vif-unplugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-unplugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Acquiring lock "adf51865-638e-4b5b-a659-48225c878b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] Lock "adf51865-638e-4b5b-a659-48225c878b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] No waiting events found dispatching network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:01:20 user nova-compute[74507]: WARNING nova.compute.manager [req-5841e03c-2217-45c0-98bd-2c8393c0cde0 req-5292ba16-8094-4ec1-ae57-b12113a76e31 service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received unexpected event network-vif-plugged-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef for instance with vm_state active and task_state deleting.
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37685f4-49d8-45b7-81ab-575e5f75ad63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d45f87-d541-49c4-a8e4-00331e8883d4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (419ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:01:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Deleting instance files /opt/stack/data/nova/instances/adf51865-638e-4b5b-a659-48225c878b51_del
Oct 25 23:01:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Deletion of /opt/stack/data/nova/instances/adf51865-638e-4b5b-a659-48225c878b51_del complete
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4e0ee296-16dc-472a-b6b0-782aa64702ca tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.739s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:20 user nova-compute[74507]: INFO nova.compute.manager [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 25 23:01:20 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:01:20 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:01:21 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:21 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: adf51865-638e-4b5b-a659-48225c878b51] Took 0.46 seconds to deallocate network for instance.
Oct 25 23:01:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:22 user nova-compute[74507]: INFO nova.compute.manager [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Took 1.02 seconds to detach 1 volumes for instance.
Oct 25 23:01:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: adf51865-638e-4b5b-a659-48225c878b51] Deleting volume: f37685f4-49d8-45b7-81ab-575e5f75ad63 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-a3a72389-9e50-46a0-a659-8ab31364a445 req-53422342-31ce-4e13-887b-9e784ba6026e service nova] [instance: adf51865-638e-4b5b-a659-48225c878b51] Received event network-vif-deleted-e2cce1f3-6d4d-4431-8001-8d6c4d9e42ef {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:22 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance adf51865-638e-4b5b-a659-48225c878b51
Oct 25 23:01:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9a819c5d-e747-41a0-be11-78f4fc2f0799 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "adf51865-638e-4b5b-a659-48225c878b51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.382s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-changed-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Refreshing instance network info cache due to event network-changed-e617056b-f3a5-4bd5-a5c5-717a0870bb03. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] Acquiring lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] Acquired lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Refreshing network info cache for port e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updated VIF entry in instance network info cache for port e617056b-f3a5-4bd5-a5c5-717a0870bb03. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updating instance_info_cache with network_info: [{"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f00d56f6-5473-4d5e-81e1-9d25d4abc318 req-8e47810c-e306-4e3e-a47b-f1bbab1cc3d8 service nova] Releasing lock "refresh_cache-987398c5-0ff2-4280-bfcb-e24f2c839aa1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Going to confirm migration 2 {{(pid=74507) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquired lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:01:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'info_cache' on Instance uuid af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [{"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Releasing lock "refresh_cache-af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'migration_context' on Instance uuid af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG nova.objects.base [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Object Instance<af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e> lazy-loaded attributes: info_cache,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:01:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.450s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:31 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Deleted allocation for migration 80f16ef4-e24d-478d-8713-4fd2626cfdc2
Oct 25 23:01:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8acbc66f-346d-4b05-8a0e-db6f7a2f57f8 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.436s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG nova.objects.instance [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:33 user nova-compute[74507]: INFO nova.compute.manager [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Attaching volume 56459313-10d8-41ab-b4a0-5aac10fd3d84 to /dev/vdb
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.utils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44100e4f-7bb5-4fbd-be1b-9ac203a562cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce85b1-71b8-442d-ad7b-5ea1221a5b15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f706dbf-8ca1-403b-a2dc-2ab40139a0cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04edfd-8eaa-42dd-af60-47079c565959]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:01:33 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:01:33 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dab6200-2972-4430-aa61-23cbee3cec21]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG os_brick.utils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:01:33 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updating existing volume attachment record: 5763e5d9-a759-492e-8012-99ee7ea8ab3b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:01:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:35 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:01:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:01:37 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [{"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:01:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-d5a1f112-41ec-401b-858a-86f213d3003b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:01:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:01:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:01:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:01:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:01:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:01:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:01:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:01:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=24.957504272460938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:01:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:01:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.858s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:01:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:01:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid d5a1f112-41ec-401b-858a-86f213d3003b {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "de04d5f3-1651-4661-bc81-390182180af3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "de04d5f3-1651-4661-bc81-390182180af3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:01:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:01:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:01:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:02:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHSypQDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:02:03 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:02:03 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:02:03 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7701693b-d01e-45da-b348-6abb0bf7bcd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:02:03 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb30982f-343b-4d9c-b4b0-335d5419a619]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84] added
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc85575-ae0d-4fdc-a3dc-81e3773fff09]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eba64e-e03b-4168-9706-ddd0af8c5c83]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHSypQDR {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KHSypQDR" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a9262-e817-4161-85c9-4385b567f5b3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KHSypQDR'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7658b735-a16a-4f98-9042-ef1eb2589c0a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb748c-fd53-4d1c-b231-4006352e641c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07cb97a-73e8-4e30-b084-56c776a6e63d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260]
Oct 25 23:02:03 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260] successful.
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d393fc30-fbc2-4d16-8f07-a847c4824e11]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfff388-144f-4577-9dd3-7a15ce9d4787]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:03 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:02:03 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9997217-b5c8-4777-b9da-6a73aca1fe0d]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:02:03 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHSypQDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23639633563326566', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639633563326566', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG nova.objects.instance [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:02:04 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:02:04 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 23:02:04 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:02:04 user nova-compute[74507]:   <serial>56459313-10d8-41ab-b4a0-5aac10fd3d84</serial>
Oct 25 23:02:04 user nova-compute[74507]: </disk>
Oct 25 23:02:04 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:02:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:f7:be:f5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-721c5284-61e4-45a3-915b-ecb28e021dca tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.869s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.520s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:02:09 user nova-compute[74507]: INFO nova.compute.claims [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Claim successful on node user
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:02:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.policy [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b65985ef3b8403da48b609e49da19db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63880132a8984ca2bdfb3e226b65a093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:02:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Creating image(s)
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.200s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk 1073741824" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Successfully created port: 9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Cannot resize image /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Ensure instance console log exists: /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Successfully updated port: 9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquired lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-changed-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Refreshing instance network info cache due to event network-changed-9804918d-87db-44be-bff1-f6c9d5c36bdc. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] Acquiring lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updating instance_info_cache with network_info: [{"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Releasing lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Instance network_info: |[{"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] Acquired lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Refreshing network info cache for port 9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Start _get_guest_xml network_info=[{"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:02:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1553546142',display_name='tempest-AttachVolumeNegativeTest-server-1553546142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1553546142',id=29,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaHMbEkWL2co2rr3b3Git5pQrBpV03fC/49FTbzRMNR9VhOqxDlKzeioHcUyKec3j7kfXESY7VnxdkTEgIkdTlW37HEkZr9/bStz7LCdbE0FmrL5+z2EO11iqlxI3TDMA==',key_name='tempest-keypair-1097808184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-tpoen0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:02:11 user nova-compute[74507]:   <uuid>8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1</uuid>
Oct 25 23:02:11 user nova-compute[74507]:   <name>instance-0000001d</name>
Oct 25 23:02:11 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:02:11 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:02:11 user nova-compute[74507]:   <metadata>
Oct 25 23:02:11 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:02:11 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1553546142</nova:name>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:02:11</nova:creationTime>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:02:11 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:02:11 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:owner>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:user uuid="8b65985ef3b8403da48b609e49da19db">tempest-AttachVolumeNegativeTest-231270075-project-member</nova:user>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:project uuid="63880132a8984ca2bdfb3e226b65a093">tempest-AttachVolumeNegativeTest-231270075</nova:project>
Oct 25 23:02:11 user nova-compute[74507]:       </nova:owner>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:02:11 user nova-compute[74507]:       <nova:ports>
Oct 25 23:02:11 user nova-compute[74507]:         <nova:port uuid="9804918d-87db-44be-bff1-f6c9d5c36bdc">
Oct 25 23:02:11 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 23:02:11 user nova-compute[74507]:         </nova:port>
Oct 25 23:02:11 user nova-compute[74507]:       </nova:ports>
Oct 25 23:02:11 user nova-compute[74507]:     </nova:instance>
Oct 25 23:02:11 user nova-compute[74507]:   </metadata>
Oct 25 23:02:11 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:02:11 user nova-compute[74507]:     <system>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="serial">8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1</entry>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="uuid">8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1</entry>
Oct 25 23:02:11 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:02:11 user nova-compute[74507]:     </system>
Oct 25 23:02:11 user nova-compute[74507]:   </sysinfo>
Oct 25 23:02:11 user nova-compute[74507]:   <os>
Oct 25 23:02:11 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:02:11 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:02:11 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:02:11 user nova-compute[74507]:   </os>
Oct 25 23:02:11 user nova-compute[74507]:   <features>
Oct 25 23:02:11 user nova-compute[74507]:     <acpi/>
Oct 25 23:02:11 user nova-compute[74507]:     <apic/>
Oct 25 23:02:11 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:02:11 user nova-compute[74507]:   </features>
Oct 25 23:02:11 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:02:11 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:02:11 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:02:11 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:02:11 user nova-compute[74507]:   </clock>
Oct 25 23:02:11 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:02:11 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:02:11 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:02:11 user nova-compute[74507]:   </cpu>
Oct 25 23:02:11 user nova-compute[74507]:   <devices>
Oct 25 23:02:11 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:02:11 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:02:11 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk"/>
Oct 25 23:02:11 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:02:11 user nova-compute[74507]:     </disk>
Oct 25 23:02:11 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:02:11 user nova-compute[74507]:       <mac address="fa:16:3e:ea:45:f5"/>
Oct 25 23:02:11 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:02:11 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:02:11 user nova-compute[74507]:       <target dev="tap9804918d-87"/>
Oct 25 23:02:11 user nova-compute[74507]:     </interface>
Oct 25 23:02:11 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:02:11 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/console.log" append="off"/>
Oct 25 23:02:11 user nova-compute[74507]:     </serial>
Oct 25 23:02:11 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:02:11 user nova-compute[74507]:     <video>
Oct 25 23:02:11 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:02:11 user nova-compute[74507]:     </video>
Oct 25 23:02:11 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:02:11 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:02:11 user nova-compute[74507]:     </rng>
Oct 25 23:02:11 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:02:11 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:02:11 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:02:11 user nova-compute[74507]:     </memballoon>
Oct 25 23:02:11 user nova-compute[74507]:   </devices>
Oct 25 23:02:11 user nova-compute[74507]: </domain>
Oct 25 23:02:11 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1553546142',display_name='tempest-AttachVolumeNegativeTest-server-1553546142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1553546142',id=29,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaHMbEkWL2co2rr3b3Git5pQrBpV03fC/49FTbzRMNR9VhOqxDlKzeioHcUyKec3j7kfXESY7VnxdkTEgIkdTlW37HEkZr9/bStz7LCdbE0FmrL5+z2EO11iqlxI3TDMA==',key_name='tempest-keypair-1097808184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-tpoen0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG os_vif [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9da2ae80-2eb6-520b-a79d-2a77ae7f5168', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9804918d-87, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9804918d-87, col_values=(('qos', UUID('8a64fdaf-2b77-4027-8e38-344903fe8ab5')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9804918d-87, col_values=(('external_ids', {'iface-id': '9804918d-87db-44be-bff1-f6c9d5c36bdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:45:f5', 'vm-uuid': '8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:11 user nova-compute[74507]: INFO os_vif [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87')
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:ea:45:f5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updated VIF entry in instance network info cache for port 9804918d-87db-44be-bff1-f6c9d5c36bdc. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updating instance_info_cache with network_info: [{"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-caff6c64-2930-4a45-b029-508d0bef5a24 req-005ed46f-f53d-4aec-bc57-172419f280ed service nova] Releasing lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] No waiting events found dispatching network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:13 user nova-compute[74507]: WARNING nova.compute.manager [req-083b3f3a-8e07-4d3e-b486-2ae3636ee6ca req-bb1c6c02-af74-4738-b726-a177d9c5670c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received unexpected event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc for instance with vm_state building and task_state spawning.
Oct 25 23:02:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:02:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Instance spawned successfully.
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] No waiting events found dispatching network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:15 user nova-compute[74507]: WARNING nova.compute.manager [req-1dd17ccc-ddd4-48e2-92ba-42eec70b336d req-b721a925-5cb8-4960-a04b-f3f2870a9f9b service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received unexpected event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc for instance with vm_state building and task_state spawning.
Oct 25 23:02:15 user nova-compute[74507]: INFO nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 25 23:02:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:02:15 user nova-compute[74507]: INFO nova.compute.manager [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Took 6.71 seconds to build instance.
Oct 25 23:02:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ed0d9c32-6f2d-4d6f-9a20-ac044ece7187 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.834s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:22 user nova-compute[74507]: INFO nova.compute.manager [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Detaching volume d9119d77-a692-49bb-9d37-5f0043360127
Oct 25 23:02:22 user nova-compute[74507]: INFO nova.virt.block_device [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Attempting to driver detach volume d9119d77-a692-49bb-9d37-5f0043360127 from mountpoint /dev/vdc
Oct 25 23:02:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Attempting to detach device vdc from instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:02:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:02:22 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:02:22 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:02:22 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:02:22 user nova-compute[74507]:   <serial>d9119d77-a692-49bb-9d37-5f0043360127</serial>
Oct 25 23:02:22 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 23:02:22 user nova-compute[74507]: </disk>
Oct 25 23:02:22 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:02:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully detached device vdc from instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 from the persistent domain config.
Oct 25 23:02:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:02:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:02:22 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:02:22 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:02:22 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:02:22 user nova-compute[74507]:   <serial>d9119d77-a692-49bb-9d37-5f0043360127</serial>
Oct 25 23:02:22 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 23:02:22 user nova-compute[74507]: </disk>
Oct 25 23:02:22 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:02:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:02:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:27 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:02:27 user nova-compute[74507]: INFO nova.compute.claims [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Claim successful on node user
Oct 25 23:02:27 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:02:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.policy [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4da245cae18d400ab7b8c787bfd10156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdf2550d504422686b0a2a829758690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:02:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Creating image(s)
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk 1073741824" returned: 0 in 0.065s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Successfully created port: ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:02:28 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Cannot resize image /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Ensure instance console log exists: /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Successfully updated port: ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-changed-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Refreshing instance network info cache due to event network-changed-ef1a384f-e06f-4df7-87c5-344d40612b40. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] Acquiring lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updating instance_info_cache with network_info: [{"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Instance network_info: |[{"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] Acquired lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Refreshing network info cache for port ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Start _get_guest_xml network_info=[{"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:02:30 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:30 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222146002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222146002',id=30,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-oa5pvw5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:28Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=8bbaa172-1185-436c-a935-f1b8bc337801,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.objects.instance [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bbaa172-1185-436c-a935-f1b8bc337801 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:02:30 user nova-compute[74507]:   <uuid>8bbaa172-1185-436c-a935-f1b8bc337801</uuid>
Oct 25 23:02:30 user nova-compute[74507]:   <name>instance-0000001e</name>
Oct 25 23:02:30 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:02:30 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:02:30 user nova-compute[74507]:   <metadata>
Oct 25 23:02:30 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:02:30 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1222146002</nova:name>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:02:30</nova:creationTime>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:02:30 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:02:30 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:owner>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 23:02:30 user nova-compute[74507]:       </nova:owner>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:02:30 user nova-compute[74507]:       <nova:ports>
Oct 25 23:02:30 user nova-compute[74507]:         <nova:port uuid="ef1a384f-e06f-4df7-87c5-344d40612b40">
Oct 25 23:02:30 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 23:02:30 user nova-compute[74507]:         </nova:port>
Oct 25 23:02:30 user nova-compute[74507]:       </nova:ports>
Oct 25 23:02:30 user nova-compute[74507]:     </nova:instance>
Oct 25 23:02:30 user nova-compute[74507]:   </metadata>
Oct 25 23:02:30 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:02:30 user nova-compute[74507]:     <system>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="serial">8bbaa172-1185-436c-a935-f1b8bc337801</entry>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="uuid">8bbaa172-1185-436c-a935-f1b8bc337801</entry>
Oct 25 23:02:30 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:02:30 user nova-compute[74507]:     </system>
Oct 25 23:02:30 user nova-compute[74507]:   </sysinfo>
Oct 25 23:02:30 user nova-compute[74507]:   <os>
Oct 25 23:02:30 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:02:30 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:02:30 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:02:30 user nova-compute[74507]:   </os>
Oct 25 23:02:30 user nova-compute[74507]:   <features>
Oct 25 23:02:30 user nova-compute[74507]:     <acpi/>
Oct 25 23:02:30 user nova-compute[74507]:     <apic/>
Oct 25 23:02:30 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:02:30 user nova-compute[74507]:   </features>
Oct 25 23:02:30 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:02:30 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:02:30 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:02:30 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:02:30 user nova-compute[74507]:   </clock>
Oct 25 23:02:30 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:02:30 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:02:30 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:02:30 user nova-compute[74507]:   </cpu>
Oct 25 23:02:30 user nova-compute[74507]:   <devices>
Oct 25 23:02:30 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:02:30 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:02:30 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk"/>
Oct 25 23:02:30 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:02:30 user nova-compute[74507]:     </disk>
Oct 25 23:02:30 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:02:30 user nova-compute[74507]:       <mac address="fa:16:3e:55:2a:b1"/>
Oct 25 23:02:30 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:02:30 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:02:30 user nova-compute[74507]:       <target dev="tapef1a384f-e0"/>
Oct 25 23:02:30 user nova-compute[74507]:     </interface>
Oct 25 23:02:30 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:02:30 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/console.log" append="off"/>
Oct 25 23:02:30 user nova-compute[74507]:     </serial>
Oct 25 23:02:30 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:02:30 user nova-compute[74507]:     <video>
Oct 25 23:02:30 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:02:30 user nova-compute[74507]:     </video>
Oct 25 23:02:30 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:02:30 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:02:30 user nova-compute[74507]:     </rng>
Oct 25 23:02:30 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:02:30 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:02:30 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:02:30 user nova-compute[74507]:     </memballoon>
Oct 25 23:02:30 user nova-compute[74507]:   </devices>
Oct 25 23:02:30 user nova-compute[74507]: </domain>
Oct 25 23:02:30 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222146002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222146002',id=30,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-oa5pvw5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:28Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=8bbaa172-1185-436c-a935-f1b8bc337801,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG os_vif [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a861d84-ac21-52d6-9421-f0be2093b5d1', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1a384f-e0, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef1a384f-e0, col_values=(('qos', UUID('5d1be765-4caa-43ff-accf-9aee3d5da5a4')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef1a384f-e0, col_values=(('external_ids', {'iface-id': 'ef1a384f-e06f-4df7-87c5-344d40612b40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:2a:b1', 'vm-uuid': '8bbaa172-1185-436c-a935-f1b8bc337801'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:30 user nova-compute[74507]: INFO os_vif [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0')
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:02:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:55:2a:b1, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updated VIF entry in instance network info cache for port ef1a384f-e06f-4df7-87c5-344d40612b40. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updating instance_info_cache with network_info: [{"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bbee537c-684f-460d-9fab-fd7d44937ad7 req-67946e8d-dc45-47c0-8657-c9aeeb8a6dc2 service nova] Releasing lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] No waiting events found dispatching network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:32 user nova-compute[74507]: WARNING nova.compute.manager [req-d6692e1b-77d0-47d6-a354-1e582bfa2539 req-5fc1a00a-29bd-4311-be54-f0c22702ba49 service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received unexpected event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 for instance with vm_state building and task_state spawning.
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:33 user nova-compute[74507]: INFO nova.compute.manager [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Terminating instance
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-1cffe611-2cdc-4875-b2ba-ec1d4f7e2f44 req-5bd4c385-4ae3-48b5-a2c2-cdeb84b82243 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-unplugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:02:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Instance destroyed successfully.
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.objects.instance [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid 85b692bd-0a00-4dd1-9ce1-cfc0e077818f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-889577759',display_name='tempest-ServerRescueNegativeTestJSON-server-889577759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-889577759',id=2,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:47:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-go0dc7hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:47:25Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=85b692bd-0a00-4dd1-9ce1-cfc0e077818f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "591a03ae-3857-490f-8720-e64e5fa6c309", "address": "fa:16:3e:a1:47:5e", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591a03ae-38", "ovs_interfaceid": "591a03ae-3857-490f-8720-e64e5fa6c309", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG os_vif [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap591a03ae-38, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ebe578b-4795-4458-bf6e-3da56a8add7f) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:02:34 user nova-compute[74507]: INFO os_vif [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:47:5e,bridge_name='br-int',has_traffic_filtering=True,id=591a03ae-3857-490f-8720-e64e5fa6c309,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591a03ae-38')
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Deleting instance files /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f_del
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Deletion of /opt/stack/data/nova/instances/85b692bd-0a00-4dd1-9ce1-cfc0e077818f_del complete
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.manager [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Instance spawned successfully.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] No waiting events found dispatching network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:34 user nova-compute[74507]: WARNING nova.compute.manager [req-7528a50d-d8e1-4ad8-94a3-5529dcb1bfd8 req-57b22c1e-14a6-4037-bb49-7c6cbb64579f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received unexpected event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 for instance with vm_state building and task_state spawning.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.claims [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Claim successful on node user
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.manager [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Took 6.90 seconds to build instance.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b24e2f03-f273-4c3f-be23-98ed2280d7c7 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.998s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Took 0.54 seconds to deallocate network for instance.
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd81ed74-2f79-49a1-a8a0-8a997cb8a71a req-32c0044f-b4f0-463b-80ab-1c94cdeafe74 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-deleted-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.compute.manager [req-fd81ed74-2f79-49a1-a8a0-8a997cb8a71a req-32c0044f-b4f0-463b-80ab-1c94cdeafe74 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Neutron deleted interface 591a03ae-3857-490f-8720-e64e5fa6c309; detaching it from the instance and deleting it from the info cache
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.network.neutron [req-fd81ed74-2f79-49a1-a8a0-8a997cb8a71a req-32c0044f-b4f0-463b-80ab-1c94cdeafe74 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd81ed74-2f79-49a1-a8a0-8a997cb8a71a req-32c0044f-b4f0-463b-80ab-1c94cdeafe74 service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Detach interface failed, port_id=591a03ae-3857-490f-8720-e64e5fa6c309, reason: Instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.058s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:02:34 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:02:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.policy [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bec0411e0f0e4e8f904477e0639d5491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b79f154615e40ce8c4ef955fb3be5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:02:35 user nova-compute[74507]: INFO nova.virt.block_device [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Booting with volume f8e70df5-f915-45eb-bc53-d16c64500886 at /dev/vda
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.utils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9490e58-c704-4e99-88a6-b2a2e1ef749f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[60981c03-5cc2-4c66-81d5-606ee1c422d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ee1804-2415-4a08-a9b0-8bf9059e1b98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85519e94-9363-4b72-bdbe-9fd4a28aec0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:02:35 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72003d14-194a-464f-9ed3-79f5e1a0cb2d]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG os_brick.utils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating existing volume attachment record: 915382a5-a47c-4fe8-9fb0-5e4dca47199e {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:35 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Deleted allocations for instance 85b692bd-0a00-4dd1-9ce1-cfc0e077818f
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-276e7807-f6d0-4174-801c-24d402fdae7b tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] Acquiring lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] Lock "85b692bd-0a00-4dd1-9ce1-cfc0e077818f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] No waiting events found dispatching network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:02:35 user nova-compute[74507]: WARNING nova.compute.manager [req-5edcfdf4-aace-4cb2-8d9b-015d62ec28d1 req-7fac9e73-a35c-4104-a720-cb97f6c4207d service nova] [instance: 85b692bd-0a00-4dd1-9ce1-cfc0e077818f] Received unexpected event network-vif-plugged-591a03ae-3857-490f-8720-e64e5fa6c309 for instance with vm_state deleted and task_state None.
Oct 25 23:02:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Successfully created port: 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Successfully updated port: 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing instance network info cache due to event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:36 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG nova.network.neutron [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance network_info: |[{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updated VIF entry in instance network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6e78a821-6a59-4bd0-b140-a57f074632cd req-4c635fc0-25ec-4ca0-bfa3-3432753fa8f0 service nova] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:02:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:02:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:02:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:02:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:02:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:02:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:02:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 is timed out.
Oct 25 23:02:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully detached device vdc from instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 from the live domain config.
Oct 25 23:02:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcMTdKgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:02:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72dcbe-a68c-48ff-822c-293440388109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:02:43 user nova-compute[74507]: No targets found.
Oct 25 23:02:43 user nova-compute[74507]: iSNS:
Oct 25 23:02:43 user nova-compute[74507]: No targets found.
Oct 25 23:02:43 user nova-compute[74507]: STATIC:
Oct 25 23:02:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:02:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:02:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:02:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127
Oct 25 23:02:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:02:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:02:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab
Oct 25 23:02:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:02:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:02:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:02:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:02:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:02:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:02:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:02:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:02:43 user nova-compute[74507]: FIRMWARE:
Oct 25 23:02:43 user nova-compute[74507]: No targets found.
Oct 25 23:02:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:02:43 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:02:43 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[434907cf-a7fb-4079-9f6a-e5350697219f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba3ce7-05bc-44d5-be00-9760c699973e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:02:43 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:02:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54477640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f07469-5c9d-4de6-a9d7-411c7ec2cc4c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[230de95d-aad2-42ca-a247-7bebabbf40fd]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2227e995-d84d-43e4-bbfb-62c0b8ef4a0c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d06bbe1-5d9c-4ca1-9184-27bb828a5826]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e0760f-cb49-412f-bb82-17270dcebdf9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9630d6-37e5-49aa-b058-6028b60ea085]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260]
Oct 25 23:02:43 user nova-compute[74507]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127, portal: 172.16.0.220,3260] successful.
Oct 25 23:02:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9119d77-a692-49bb-9d37-5f0043360127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc6e711-ce89-45b2-bd91-ebed579425b6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] <== disconnect_volume: return (414ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'flavor' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4592f7b0-4f69-4bc0-b3ae-73b03e7f562a tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:02:45 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:45 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=24.943355560302734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de04d5f3-1651-4661-bc81-390182180af3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d3fd54be-06e8-4020-a67b-350a1c8f32c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:02:45 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:02:46 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:02:46 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:02:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:02:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:02:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:02:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:02:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:02:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing instance network info cache due to event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updated VIF entry in instance network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG nova.network.neutron [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e23eb6d0-67cf-4ff3-a5a2-00e0d8d48415 req-368ce041-025d-433a-953c-c66422897fe1 service nova] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing instance network info cache due to event network-changed-2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] Acquiring lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] Acquired lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Refreshing network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:06 user nova-compute[74507]: INFO nova.compute.manager [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Detaching volume 75a62920-e57c-4ca4-83a3-7c1a404a6dab
Oct 25 23:03:06 user nova-compute[74507]: INFO nova.virt.block_device [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Attempting to driver detach volume 75a62920-e57c-4ca4-83a3-7c1a404a6dab from mountpoint /dev/vdb
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Attempting to detach device vdb from instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:03:06 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:03:06 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:03:06 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:03:06 user nova-compute[74507]:   <serial>75a62920-e57c-4ca4-83a3-7c1a404a6dab</serial>
Oct 25 23:03:06 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 23:03:06 user nova-compute[74507]: </disk>
Oct 25 23:03:06 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:03:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully detached device vdb from instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 from the persistent domain config.
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:03:06 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:03:06 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:03:06 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:03:06 user nova-compute[74507]:   <serial>75a62920-e57c-4ca4-83a3-7c1a404a6dab</serial>
Oct 25 23:03:06 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 23:03:06 user nova-compute[74507]: </disk>
Oct 25 23:03:06 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updated VIF entry in instance network info cache for port 2dad3624-c2f3-4ff5-bad3-e755c3204a39. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.network.neutron [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [{"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90fb2749-dcae-4d60-a837-afc9bd18b0a4 req-8dfdc23b-991f-4b02-8b9c-9f542cdde5ff service nova] Releasing lock "refresh_cache-96c4f0c8-0ed6-413b-9c85-3327c0317a19" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:03:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:13 user nova-compute[74507]: INFO nova.compute.manager [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Terminating instance
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-0c5529cf-3d98-4c4a-8f09-5ba6dcf11e07 req-1fe93f26-4137-4493-ae79-81fec788cf50 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-unplugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Instance destroyed successfully.
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.objects.instance [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'resources' on Instance uuid c59e7e75-ee1c-4751-8ef2-b46f80c9d907 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T22:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1689378523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1689378523',id=22,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0hiv9yMtDjZTMkufqi5csgWB0Phha38jJy5AW02qg2ZcXsPpjrurEkOngOSvnqQIhBjDpyYu+yzfVk3U+a0xnzMyVB+K5J14IXj3RByqmPJtdMhnilfmU4yluKgF/zSg==',key_name='tempest-keypair-383944364',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-cqb0cuur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=c59e7e75-ee1c-4751-8ef2-b46f80c9d907,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "address": "fa:16:3e:21:93:f4", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb8c7f9-45", "ovs_interfaceid": "9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG os_vif [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cb8c7f9-45, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b178b386-e66f-4e4b-a318-2cbe0d814496) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:13 user nova-compute[74507]: INFO os_vif [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:93:f4,bridge_name='br-int',has_traffic_filtering=True,id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb8c7f9-45')
Oct 25 23:03:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Deleting instance files /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907_del
Oct 25 23:03:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Deletion of /opt/stack/data/nova/instances/c59e7e75-ee1c-4751-8ef2-b46f80c9d907_del complete
Oct 25 23:03:14 user nova-compute[74507]: INFO nova.compute.manager [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 23:03:14 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:14 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Took 0.85 seconds to deallocate network for instance.
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-d97be904-9077-46f9-9cd8-db1d683f8b39 req-0c64ea22-3cc7-44fe-ad28-d5e13f6e0ed6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-deleted-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:14 user nova-compute[74507]: INFO nova.compute.manager [req-d97be904-9077-46f9-9cd8-db1d683f8b39 req-0c64ea22-3cc7-44fe-ad28-d5e13f6e0ed6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Neutron deleted interface 9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5; detaching it from the instance and deleting it from the info cache
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.network.neutron [req-d97be904-9077-46f9-9cd8-db1d683f8b39 req-0c64ea22-3cc7-44fe-ad28-d5e13f6e0ed6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-d97be904-9077-46f9-9cd8-db1d683f8b39 req-0c64ea22-3cc7-44fe-ad28-d5e13f6e0ed6 service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Detach interface failed, port_id=9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5, reason: Instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:03:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Creating image(s)
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Ensure instance console log exists: /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start _get_guest_xml network_info=[{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '915382a5-a47c-4fe8-9fb0-5e4dca47199e', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3fd54be-06e8-4020-a67b-350a1c8f32c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8e70df5-f915-45eb-bc53-d16c64500886', 'serial': 'f8e70df5-f915-45eb-bc53-d16c64500886'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:03:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:03:15 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:03:15 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:03:15 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f8271-5e47-4758-9c66-3ee557fd6c25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:03:15 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7b9dc-6834-479a-bcf1-f6a58cd68e90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886] added
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256c9be-6ebb-4891-bb21-9dcbb8231174]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b093c9a6-da4a-40d9-9f95-7172e003b18d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Deleted allocations for instance c59e7e75-ee1c-4751-8ef2-b46f80c9d907
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwZCGRvr {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] Acquiring lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] No waiting events found dispatching network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:15 user nova-compute[74507]: WARNING nova.compute.manager [req-2155e870-7cf0-470e-884f-5812e6bc2f54 req-f46966e8-d005-4d44-ac6e-cd711f7a5dec service nova] [instance: c59e7e75-ee1c-4751-8ef2-b46f80c9d907] Received unexpected event network-vif-plugged-9cb8c7f9-4509-47c5-ac8c-9f102c2bf9b5 for instance with vm_state deleted and task_state None.
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwZCGRvr" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29ac37-fb76-4bcb-8678-6b23decd0d06]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwZCGRvr'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae1881e-0aa9-475b-a8d0-6ba1f8429437]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb372da5-c60d-4c8b-b5c7-c95cf1afe262]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81ffefe4-83c6-4e53-8e13-c44d4ba44cd8 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "c59e7e75-ee1c-4751-8ef2-b46f80c9d907" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5b03af-b2f7-411b-9726-509cbd88087d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]
Oct 25 23:03:15 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ae76aa-29f5-4c39-961a-da09c0b26ebd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862b4c7-4e13-4ba4-be5b-07e7edb88546]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a55fd47-0485-446e-870f-2b77f1317e18]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23331333034343263', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331333034343263', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY4dqTZZtuKpbWuvSXuAGTGLKOG2AhqLGYVJbt3Wl/sbw9b8UrezvSYI5pDXPkJ408lc1u34VyvgKMURb0Ay/YPV7naGKRcgQJdLzcDGLabhGLdOAvtQ5TliD4/FK22Sg==',key_name='tempest-TestShelveInstance-585482898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:35Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'pci_devices' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:03:16 user nova-compute[74507]:   <uuid>d3fd54be-06e8-4020-a67b-350a1c8f32c6</uuid>
Oct 25 23:03:16 user nova-compute[74507]:   <name>instance-0000001f</name>
Oct 25 23:03:16 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:03:16 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:03:16 user nova-compute[74507]:   <metadata>
Oct 25 23:03:16 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:03:16 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:03:16 user nova-compute[74507]:       <nova:name>tempest-TestShelveInstance-server-1508559622</nova:name>
Oct 25 23:03:16 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:03:15</nova:creationTime>
Oct 25 23:03:16 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:03:16 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:03:16 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:03:16 user nova-compute[74507]:       <nova:owner>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:user uuid="bec0411e0f0e4e8f904477e0639d5491">tempest-TestShelveInstance-65908321-project-member</nova:user>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:project uuid="9b79f154615e40ce8c4ef955fb3be5ef">tempest-TestShelveInstance-65908321</nova:project>
Oct 25 23:03:16 user nova-compute[74507]:       </nova:owner>
Oct 25 23:03:16 user nova-compute[74507]:       <nova:ports>
Oct 25 23:03:16 user nova-compute[74507]:         <nova:port uuid="4c0e9752-7776-4583-a467-68ac9bcf9c10">
Oct 25 23:03:16 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 23:03:16 user nova-compute[74507]:         </nova:port>
Oct 25 23:03:16 user nova-compute[74507]:       </nova:ports>
Oct 25 23:03:16 user nova-compute[74507]:     </nova:instance>
Oct 25 23:03:16 user nova-compute[74507]:   </metadata>
Oct 25 23:03:16 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:03:16 user nova-compute[74507]:     <system>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="serial">d3fd54be-06e8-4020-a67b-350a1c8f32c6</entry>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="uuid">d3fd54be-06e8-4020-a67b-350a1c8f32c6</entry>
Oct 25 23:03:16 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:03:16 user nova-compute[74507]:     </system>
Oct 25 23:03:16 user nova-compute[74507]:   </sysinfo>
Oct 25 23:03:16 user nova-compute[74507]:   <os>
Oct 25 23:03:16 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:03:16 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:03:16 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:03:16 user nova-compute[74507]:   </os>
Oct 25 23:03:16 user nova-compute[74507]:   <features>
Oct 25 23:03:16 user nova-compute[74507]:     <acpi/>
Oct 25 23:03:16 user nova-compute[74507]:     <apic/>
Oct 25 23:03:16 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:03:16 user nova-compute[74507]:   </features>
Oct 25 23:03:16 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:03:16 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:03:16 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:03:16 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:03:16 user nova-compute[74507]:   </clock>
Oct 25 23:03:16 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:03:16 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:03:16 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:03:16 user nova-compute[74507]:   </cpu>
Oct 25 23:03:16 user nova-compute[74507]:   <devices>
Oct 25 23:03:16 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:03:16 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:03:16 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 23:03:16 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:03:16 user nova-compute[74507]:       <serial>f8e70df5-f915-45eb-bc53-d16c64500886</serial>
Oct 25 23:03:16 user nova-compute[74507]:     </disk>
Oct 25 23:03:16 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:03:16 user nova-compute[74507]:       <mac address="fa:16:3e:b2:ea:96"/>
Oct 25 23:03:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:03:16 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:03:16 user nova-compute[74507]:       <target dev="tap4c0e9752-77"/>
Oct 25 23:03:16 user nova-compute[74507]:     </interface>
Oct 25 23:03:16 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:03:16 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6/console.log" append="off"/>
Oct 25 23:03:16 user nova-compute[74507]:     </serial>
Oct 25 23:03:16 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:03:16 user nova-compute[74507]:     <video>
Oct 25 23:03:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:03:16 user nova-compute[74507]:     </video>
Oct 25 23:03:16 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:03:16 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:03:16 user nova-compute[74507]:     </rng>
Oct 25 23:03:16 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:03:16 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:03:16 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:03:16 user nova-compute[74507]:     </memballoon>
Oct 25 23:03:16 user nova-compute[74507]:   </devices>
Oct 25 23:03:16 user nova-compute[74507]: </domain>
Oct 25 23:03:16 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY4dqTZZtuKpbWuvSXuAGTGLKOG2AhqLGYVJbt3Wl/sbw9b8UrezvSYI5pDXPkJ408lc1u34VyvgKMURb0Ay/YPV7naGKRcgQJdLzcDGLabhGLdOAvtQ5TliD4/FK22Sg==',key_name='tempest-TestShelveInstance-585482898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:02:35Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG os_vif [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9eb6c86b-4ddf-5fd6-87a4-b06e904a8751', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c0e9752-77, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c0e9752-77, col_values=(('qos', UUID('43079db6-20c9-40a8-878b-7da4a30e0b34')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c0e9752-77, col_values=(('external_ids', {'iface-id': '4c0e9752-7776-4583-a467-68ac9bcf9c10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ea:96', 'vm-uuid': 'd3fd54be-06e8-4020-a67b-350a1c8f32c6'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:16 user nova-compute[74507]: INFO os_vif [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77')
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:03:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] No VIF found with MAC fa:16:3e:b2:ea:96, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:18 user nova-compute[74507]: WARNING nova.compute.manager [req-99b0010c-1cfa-4893-99c6-31588c3fe2c6 req-f7337a4d-e2d8-4bf8-97cd-1906448816eb service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state building and task_state spawning.
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:03:18 user nova-compute[74507]: INFO nova.compute.claims [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Claim successful on node user
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:03:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.policy [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:03:19 user nova-compute[74507]: INFO nova.virt.block_device [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Booting with volume 79fba4bf-770c-469c-818a-f02d9b0a1314 at /dev/vda
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.utils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f897b-a49f-4264-8b91-1034709efcbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ab3f8f-b99b-4de1-bec8-2f4197a212b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95b404-490c-420a-a427-09602b21305b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e40a1ba-88af-44d2-b9f5-a50f75fb6b6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:03:19 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:03:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2483ed2a-b94e-4a92-8881-9d40fd8986e2]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG os_brick.utils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updating existing volume attachment record: 43df2efa-31ef-4378-b3f5-065b9c7b371c {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:03:19 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Successfully created port: 3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:03:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance spawned successfully.
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:20 user nova-compute[74507]: WARNING nova.compute.manager [req-e904f750-42fd-4208-8e13-72fd99b337cc req-fcc0a066-0aaf-4e60-a9c5-f0bf28e88e03 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state building and task_state spawning.
Oct 25 23:03:20 user nova-compute[74507]: INFO nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Took 5.33 seconds to spawn the instance on the hypervisor.
Oct 25 23:03:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:03:20 user nova-compute[74507]: INFO nova.compute.manager [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Took 46.49 seconds to build instance.
Oct 25 23:03:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-691a9c57-1919-4d19-968a-ac17496ff1e2 tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.631s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:20 user nova-compute[74507]: INFO nova.compute.manager [None req-4507dc3f-3198-4751-8eb6-1bd22c5718d3 tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Get console output
Oct 25 23:03:20 user nova-compute[74507]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Successfully updated port: 3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-changed-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Refreshing instance network info cache due to event network-changed-3a01894c-7488-4f97-b320-f414fae48176. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] Acquiring lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.network.neutron [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updating instance_info_cache with network_info: [{"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Instance network_info: |[{"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] Acquired lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Refreshing network info cache for port 3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:03:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updated VIF entry in instance network info cache for port 3a01894c-7488-4f97-b320-f414fae48176. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:03:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updating instance_info_cache with network_info: [{"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a04418da-7a72-421b-ab33-50d765950b98 req-ce0c9d71-69c9-46db-b0cb-2cf117a442c1 service nova] Releasing lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:23 user nova-compute[74507]: INFO nova.compute.manager [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Terminating instance
Oct 25 23:03:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Instance destroyed successfully.
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lazy-loading 'resources' on Instance uuid de04d5f3-1651-4661-bc81-390182180af3 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1851963803',display_name='tempest-ServerRescueNegativeTestJSON-server-1851963803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1851963803',id=1,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70aab19396a0456fbe1e2dc9a8829bcb',ramdisk_id='',reservation_id='r-55d4youq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-583210992',owner_user_name='tempest-ServerRescueNegativeTestJSON-583210992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:52:13Z,user_data=None,user_id='4427778755994cca9d47b515e4aed8ea',uuid=de04d5f3-1651-4661-bc81-390182180af3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converting VIF {"id": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "address": "fa:16:3e:53:e2:24", "network": {"id": "637c5bed-8e0f-4e54-92e1-471d24704d82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-715036378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70aab19396a0456fbe1e2dc9a8829bcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbffb64da-2a", "ovs_interfaceid": "bffb64da-2a84-46a7-a0eb-383e1d71cf4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG os_vif [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbffb64da-2a, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-16163c80-a179-4978-942d-095735b7a619 req-e5939990-c9db-4838-a7c0-576747f06bc0 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-unplugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=664628e5-e9bc-4ebd-89cb-4b3000a16ad2) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:24 user nova-compute[74507]: INFO os_vif [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e2:24,bridge_name='br-int',has_traffic_filtering=True,id=bffb64da-2a84-46a7-a0eb-383e1d71cf4f,network=Network(637c5bed-8e0f-4e54-92e1-471d24704d82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbffb64da-2a')
Oct 25 23:03:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Deleting instance files /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3_del
Oct 25 23:03:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Deletion of /opt/stack/data/nova/instances/de04d5f3-1651-4661-bc81-390182180af3_del complete
Oct 25 23:03:24 user nova-compute[74507]: INFO nova.compute.manager [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] [instance: de04d5f3-1651-4661-bc81-390182180af3] Took 0.80 seconds to destroy the instance on the hypervisor.
Oct 25 23:03:24 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:03:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:25 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: de04d5f3-1651-4661-bc81-390182180af3] Took 0.60 seconds to deallocate network for instance.
Oct 25 23:03:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-1d54fd58-1602-4c67-bad7-e73d8ab083f5 req-617aee50-6a67-4208-a023-687d9941d423 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-deleted-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:03:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:25 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Deleted allocations for instance de04d5f3-1651-4661-bc81-390182180af3
Oct 25 23:03:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ffec7029-1ee3-4a7e-9752-bef17d2b87a4 tempest-ServerRescueNegativeTestJSON-583210992 tempest-ServerRescueNegativeTestJSON-583210992-project-member] Lock "de04d5f3-1651-4661-bc81-390182180af3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] Acquiring lock "de04d5f3-1651-4661-bc81-390182180af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] Lock "de04d5f3-1651-4661-bc81-390182180af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] No waiting events found dispatching network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:26 user nova-compute[74507]: WARNING nova.compute.manager [req-2d6b2550-0dfb-4bee-b5d7-849ce2a00bdb req-538e0a49-9c81-410d-aed2-99055d2a6d92 service nova] [instance: de04d5f3-1651-4661-bc81-390182180af3] Received unexpected event network-vif-plugged-bffb64da-2a84-46a7-a0eb-383e1d71cf4f for instance with vm_state deleted and task_state None.
Oct 25 23:03:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 is timed out.
Oct 25 23:03:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully detached device vdb from instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 from the live domain config.
Oct 25 23:03:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYHOIgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:03:26 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbe77b7-3a19-469d-8769-cf69d640c4bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:03:26 user nova-compute[74507]: No targets found.
Oct 25 23:03:26 user nova-compute[74507]: iSNS:
Oct 25 23:03:26 user nova-compute[74507]: No targets found.
Oct 25 23:03:26 user nova-compute[74507]: STATIC:
Oct 25 23:03:26 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886
Oct 25 23:03:26 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:03:26 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:03:26 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:03:26 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:03:26 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:03:26 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab
Oct 25 23:03:26 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:03:26 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:03:26 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:03:26 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:03:26 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:03:26 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:03:26 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:03:26 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:03:26 user nova-compute[74507]: FIRMWARE:
Oct 25 23:03:26 user nova-compute[74507]: No targets found.
Oct 25 23:03:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:03:26 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:03:26 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab83850-20b5-4fe1-af44-5d0979ea95d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[06359355-a849-435f-b631-278de566d41f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54477d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:03:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c5b63-241b-4175-a7f5-238242d86f8a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f2ddd-e702-49cd-9979-87851544efa2]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d8823-a56c-4a24-a32d-e125da08799d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89239b4-8e05-481d-a881-81cc8a2d064e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7b1d15-6cbf-446d-be96-15dc1b32c898]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5a36a-a7da-4bb5-a588-f14d99128fe9]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260]
Oct 25 23:03:27 user nova-compute[74507]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab, portal: 172.16.0.220,3260] successful.
Oct 25 23:03:27 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a62920-e57c-4ca4-83a3-7c1a404a6dab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea54c7b3-f7b7-42b5-a3c8-5bbeba0bad32]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== disconnect_volume: return (327ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:03:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:03:28 user nova-compute[74507]: DEBUG nova.objects.instance [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:03:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-20997872-9a96-4a6c-bb8e-d1abd15b07e4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.942s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:03:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Creating image(s)
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Ensure instance console log exists: /opt/stack/data/nova/instances/b79e0322-0c82-47ec-84b8-9943678f00d9/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Start _get_guest_xml network_info=[{"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '43df2efa-31ef-4378-b3f5-065b9c7b371c', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhDdOWoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b79e0322-0c82-47ec-84b8-9943678f00d9', 'attached_at': '', 'detached_at': '', 'volume_id': '79fba4bf-770c-469c-818a-f02d9b0a1314', 'serial': '79fba4bf-770c-469c-818a-f02d9b0a1314'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:03:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhDdOWoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:03:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:03:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:03:39 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[158fa8eb-150b-4df0-98ef-d1d0843b521f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:03:39 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804e61a-277a-4caa-9af4-0348b25bc6b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314] added
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7fcb3-2e74-4a63-98a6-bc3d35266abc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bff9e43-dcb5-4387-a2c5-ce954e7f54b1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhDdOWoQ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhDdOWoQ" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853e35f-dc1f-4de2-b4d5-ff7e091e3d48]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhDdOWoQ'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc2931-16e1-4892-a49b-c25b9c8365d2]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3031c5-6856-43bb-aec8-826040f634f5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7fab3-52dc-4f78-9f6f-8ba88317efa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260]
Oct 25 23:03:39 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260] successful.
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e76a8-6217-4957-b61b-b0bee570162c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f28f8-4190-4769-b7d2-7a2531cf135a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:03:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25065d29-3078-4431-9877-f574edb760aa]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhDdOWoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26233386539353630', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233386539353630', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2118522201',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMJjOH4uQeu9x4bGnikepXnITQ9JboYE4tYqso71fKDtxM76yM2h1KPqJ0yzSA0oVU4i9E1Jn2ha7/XJ9I+hwKy9siG9Nh1JZndven9pp5zjAHP2NLcWTcFc1I7MGWP2A==',key_name='tempest-keypair-34917203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0abrj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b79e0322-0c82-47ec-84b8-9943678f00d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid b79e0322-0c82-47ec-84b8-9943678f00d9 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:03:40 user nova-compute[74507]:   <uuid>b79e0322-0c82-47ec-84b8-9943678f00d9</uuid>
Oct 25 23:03:40 user nova-compute[74507]:   <name>instance-00000020</name>
Oct 25 23:03:40 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:03:40 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:03:40 user nova-compute[74507]:   <metadata>
Oct 25 23:03:40 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:03:40 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:03:40 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2118522201</nova:name>
Oct 25 23:03:40 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:03:39</nova:creationTime>
Oct 25 23:03:40 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:03:40 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:03:40 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:03:40 user nova-compute[74507]:       <nova:owner>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 23:03:40 user nova-compute[74507]:       </nova:owner>
Oct 25 23:03:40 user nova-compute[74507]:       <nova:ports>
Oct 25 23:03:40 user nova-compute[74507]:         <nova:port uuid="3a01894c-7488-4f97-b320-f414fae48176">
Oct 25 23:03:40 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 23:03:40 user nova-compute[74507]:         </nova:port>
Oct 25 23:03:40 user nova-compute[74507]:       </nova:ports>
Oct 25 23:03:40 user nova-compute[74507]:     </nova:instance>
Oct 25 23:03:40 user nova-compute[74507]:   </metadata>
Oct 25 23:03:40 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:03:40 user nova-compute[74507]:     <system>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="serial">b79e0322-0c82-47ec-84b8-9943678f00d9</entry>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="uuid">b79e0322-0c82-47ec-84b8-9943678f00d9</entry>
Oct 25 23:03:40 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:03:40 user nova-compute[74507]:     </system>
Oct 25 23:03:40 user nova-compute[74507]:   </sysinfo>
Oct 25 23:03:40 user nova-compute[74507]:   <os>
Oct 25 23:03:40 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:03:40 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:03:40 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:03:40 user nova-compute[74507]:   </os>
Oct 25 23:03:40 user nova-compute[74507]:   <features>
Oct 25 23:03:40 user nova-compute[74507]:     <acpi/>
Oct 25 23:03:40 user nova-compute[74507]:     <apic/>
Oct 25 23:03:40 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:03:40 user nova-compute[74507]:   </features>
Oct 25 23:03:40 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:03:40 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:03:40 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:03:40 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:03:40 user nova-compute[74507]:   </clock>
Oct 25 23:03:40 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:03:40 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:03:40 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:03:40 user nova-compute[74507]:   </cpu>
Oct 25 23:03:40 user nova-compute[74507]:   <devices>
Oct 25 23:03:40 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:03:40 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:03:40 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 23:03:40 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:03:40 user nova-compute[74507]:       <serial>79fba4bf-770c-469c-818a-f02d9b0a1314</serial>
Oct 25 23:03:40 user nova-compute[74507]:     </disk>
Oct 25 23:03:40 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:03:40 user nova-compute[74507]:       <mac address="fa:16:3e:ff:90:44"/>
Oct 25 23:03:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:03:40 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:03:40 user nova-compute[74507]:       <target dev="tap3a01894c-74"/>
Oct 25 23:03:40 user nova-compute[74507]:     </interface>
Oct 25 23:03:40 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:03:40 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/b79e0322-0c82-47ec-84b8-9943678f00d9/console.log" append="off"/>
Oct 25 23:03:40 user nova-compute[74507]:     </serial>
Oct 25 23:03:40 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:03:40 user nova-compute[74507]:     <video>
Oct 25 23:03:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:03:40 user nova-compute[74507]:     </video>
Oct 25 23:03:40 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:03:40 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:03:40 user nova-compute[74507]:     </rng>
Oct 25 23:03:40 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:03:40 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:03:40 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:03:40 user nova-compute[74507]:     </memballoon>
Oct 25 23:03:40 user nova-compute[74507]:   </devices>
Oct 25 23:03:40 user nova-compute[74507]: </domain>
Oct 25 23:03:40 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2118522201',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMJjOH4uQeu9x4bGnikepXnITQ9JboYE4tYqso71fKDtxM76yM2h1KPqJ0yzSA0oVU4i9E1Jn2ha7/XJ9I+hwKy9siG9Nh1JZndven9pp5zjAHP2NLcWTcFc1I7MGWP2A==',key_name='tempest-keypair-34917203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0abrj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b79e0322-0c82-47ec-84b8-9943678f00d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG os_vif [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8995acf9-07f2-5e67-a452-2fd8e287cb3c', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a01894c-74, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a01894c-74, col_values=(('qos', UUID('9337608b-c9c6-4d61-ba85-3e4969941acb')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a01894c-74, col_values=(('external_ids', {'iface-id': '3a01894c-7488-4f97-b320-f414fae48176', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:90:44', 'vm-uuid': 'b79e0322-0c82-47ec-84b8-9943678f00d9'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:40 user nova-compute[74507]: INFO os_vif [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74')
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:03:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:ff:90:44, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:03:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] No waiting events found dispatching network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:42 user nova-compute[74507]: WARNING nova.compute.manager [req-0e2bcba9-5198-4a7a-9a8b-37776708c20c req-a490ace0-3d6b-4a4c-a29f-08b0bf42c4e2 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received unexpected event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 for instance with vm_state building and task_state spawning.
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:03:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:03:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Instance spawned successfully.
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] No waiting events found dispatching network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:03:44 user nova-compute[74507]: WARNING nova.compute.manager [req-244ed9f9-f004-4fe9-ae9b-1141e76a234c req-3c3446a4-4e6b-459b-900c-ab6aa1a271f6 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received unexpected event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 for instance with vm_state building and task_state spawning.
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:03:44 user nova-compute[74507]: INFO nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:44 user nova-compute[74507]: INFO nova.compute.manager [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Took 25.94 seconds to build instance.
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-01f261b7-c432-4657-8f11-ae4f594a6c9d tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.053s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:03:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:46 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:46 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7636MB free_disk=24.951400756835938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d3fd54be-06e8-4020-a67b-350a1c8f32c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b79e0322-0c82-47ec-84b8-9943678f00d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:03:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:03:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:03:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:03:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:03:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:03:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:03:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:03:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:03:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-changed-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:03:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Refreshing instance network info cache due to event network-changed-9804918d-87db-44be-bff1-f6c9d5c36bdc. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:03:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] Acquiring lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:03:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] Acquired lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:03:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Refreshing network info cache for port 9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG nova.network.neutron [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updated VIF entry in instance network info cache for port 9804918d-87db-44be-bff1-f6c9d5c36bdc. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG nova.network.neutron [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updating instance_info_cache with network_info: [{"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-915c91e6-c8b0-48cb-af05-84fa65899297 req-5db1b833-2b34-46e6-9083-02679fc6a750 service nova] Releasing lock "refresh_cache-8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:04:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:01 user nova-compute[74507]: INFO nova.compute.manager [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Terminating instance
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-unplugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] No waiting events found dispatching network-vif-unplugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-de3f9699-d516-41fd-b55d-d0ee8e3ba09c req-5950168f-4c1f-4d8c-8c8c-3cbd424a8926 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-unplugged-9804918d-87db-44be-bff1-f6c9d5c36bdc for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Instance destroyed successfully.
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.objects.instance [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'resources' on Instance uuid 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1553546142',display_name='tempest-AttachVolumeNegativeTest-server-1553546142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1553546142',id=29,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaHMbEkWL2co2rr3b3Git5pQrBpV03fC/49FTbzRMNR9VhOqxDlKzeioHcUyKec3j7kfXESY7VnxdkTEgIkdTlW37HEkZr9/bStz7LCdbE0FmrL5+z2EO11iqlxI3TDMA==',key_name='tempest-keypair-1097808184',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:02:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-tpoen0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:02:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "address": "fa:16:3e:ea:45:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9804918d-87", "ovs_interfaceid": "9804918d-87db-44be-bff1-f6c9d5c36bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG os_vif [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9804918d-87, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a64fdaf-2b77-4027-8e38-344903fe8ab5) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:01 user nova-compute[74507]: INFO os_vif [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:f5,bridge_name='br-int',has_traffic_filtering=True,id=9804918d-87db-44be-bff1-f6c9d5c36bdc,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9804918d-87')
Oct 25 23:04:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Deleting instance files /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1_del
Oct 25 23:04:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Deletion of /opt/stack/data/nova/instances/8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1_del complete
Oct 25 23:04:01 user nova-compute[74507]: INFO nova.compute.manager [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 25 23:04:01 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:04:01 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:02 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Took 0.64 seconds to deallocate network for instance.
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-37c33340-033a-4701-8213-9984df8a73bb req-cf4b8eae-340f-4560-af1f-bce3c3774f3c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-deleted-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:02 user nova-compute[74507]: INFO nova.compute.manager [req-37c33340-033a-4701-8213-9984df8a73bb req-cf4b8eae-340f-4560-af1f-bce3c3774f3c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Neutron deleted interface 9804918d-87db-44be-bff1-f6c9d5c36bdc; detaching it from the instance and deleting it from the info cache
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.network.neutron [req-37c33340-033a-4701-8213-9984df8a73bb req-cf4b8eae-340f-4560-af1f-bce3c3774f3c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.compute.manager [req-37c33340-033a-4701-8213-9984df8a73bb req-cf4b8eae-340f-4560-af1f-bce3c3774f3c service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Detach interface failed, port_id=9804918d-87db-44be-bff1-f6c9d5c36bdc, reason: Instance 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:02 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Deleted allocations for instance 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1
Oct 25 23:04:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-eba12550-b986-4e68-89e7-1dbb740bd754 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] Acquiring lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] Lock "8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] No waiting events found dispatching network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:03 user nova-compute[74507]: WARNING nova.compute.manager [req-1dd1171b-ee09-4304-91a0-e35f1ff70828 req-207a2c36-39eb-4907-bee0-19d50a50a064 service nova] [instance: 8f9ca3cc-a589-47e6-9c89-91ad9aa5bad1] Received unexpected event network-vif-plugged-9804918d-87db-44be-bff1-f6c9d5c36bdc for instance with vm_state deleted and task_state None.
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:06 user nova-compute[74507]: INFO nova.compute.manager [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Terminating instance
Oct 25 23:04:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-39bfdb5c-7f9f-44df-9bdf-3cfc8bedca98 req-76e25a96-54d9-42dd-9caa-ecf7eceda517 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-unplugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.compute.claims [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Claim successful on node user
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Instance destroyed successfully.
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'resources' on Instance uuid 96c4f0c8-0ed6-413b-9c85-3327c0317a19 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1757322610',display_name='tempest-TestMinimumBasicScenario-server-1757322610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1757322610',id=26,image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRnZzkYws/HI5yQy7pRGVAC33rISmQtM8qr59XbnUhlxUXaob9GdArZZzczM++AGe72HOIY4GIlBHQBAGdTbxBtAOQxPZ9cSI1s5xFeqmcG400OVEicGPhbdYVXoTZqHg==',key_name='tempest-TestMinimumBasicScenario-643758233',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-55vd9b03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2f80a88e-f2c3-4a17-bfb9-14f22ebf231d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:01:21Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=96c4f0c8-0ed6-413b-9c85-3327c0317a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "address": "fa:16:3e:e3:3b:9f", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dad3624-c2", "ovs_interfaceid": "2dad3624-c2f3-4ff5-bad3-e755c3204a39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG os_vif [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dad3624-c2, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cda6da9-5a98-46d3-ac02-a77a1d8c4712) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:07 user nova-compute[74507]: INFO os_vif [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:3b:9f,bridge_name='br-int',has_traffic_filtering=True,id=2dad3624-c2f3-4ff5-bad3-e755c3204a39,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dad3624-c2')
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Deleting instance files /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19_del
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Deletion of /opt/stack/data/nova/instances/96c4f0c8-0ed6-413b-9c85-3327c0317a19_del complete
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.compute.manager [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.policy [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b81defc8e43843d3b14cc249f9e7dd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf59e935fe4170b38670efe09764dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Took 0.50 seconds to deallocate network for instance.
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:04:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Creating image(s)
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk 1073741824" returned: 0 in 0.063s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:08 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Deleted allocations for instance 96c4f0c8-0ed6-413b-9c85-3327c0317a19
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.217s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Successfully created port: f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f58af8ce-0b95-4114-99ef-e3874a435a71 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Cannot resize image /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Ensure instance console log exists: /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] Acquiring lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] Lock "96c4f0c8-0ed6-413b-9c85-3327c0317a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] No waiting events found dispatching network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:08 user nova-compute[74507]: WARNING nova.compute.manager [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received unexpected event network-vif-plugged-2dad3624-c2f3-4ff5-bad3-e755c3204a39 for instance with vm_state deleted and task_state None.
Oct 25 23:04:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c4277c7-b690-4c5b-ac06-2b81380be026 req-f8e7470a-8104-44b4-b43d-2bbee375b529 service nova] [instance: 96c4f0c8-0ed6-413b-9c85-3327c0317a19] Received event network-vif-deleted-2dad3624-c2f3-4ff5-bad3-e755c3204a39 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Successfully updated port: f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing instance network info cache due to event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:04:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance network_info: |[{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start _get_guest_xml network_info=[{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:04:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:04:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdVqVEnG1tvrbE8SC8UEexV7JtUnUaATUT4JKZpKC/7naF7IKNc9ZOj10wlChq4N7oMMJekJPGsCLRq8r1MXq1sxSgiUa9LSykPcKGD9svl+P52qMBHvPmTptt8X86yyg==',key_name='tempest-keypair-2023587710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_devices' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:04:10 user nova-compute[74507]:   <uuid>d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</uuid>
Oct 25 23:04:10 user nova-compute[74507]:   <name>instance-00000021</name>
Oct 25 23:04:10 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:04:10 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:04:10 user nova-compute[74507]:   <metadata>
Oct 25 23:04:10 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:04:10 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1923410532</nova:name>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:04:10</nova:creationTime>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:04:10 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:04:10 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:owner>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:user uuid="b81defc8e43843d3b14cc249f9e7dd73">tempest-AttachVolumeShelveTestJSON-2059391716-project-member</nova:user>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:project uuid="efbf59e935fe4170b38670efe09764dc">tempest-AttachVolumeShelveTestJSON-2059391716</nova:project>
Oct 25 23:04:10 user nova-compute[74507]:       </nova:owner>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:04:10 user nova-compute[74507]:       <nova:ports>
Oct 25 23:04:10 user nova-compute[74507]:         <nova:port uuid="f5d436ee-d7f9-42a7-ae52-646b1a57c6c7">
Oct 25 23:04:10 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 23:04:10 user nova-compute[74507]:         </nova:port>
Oct 25 23:04:10 user nova-compute[74507]:       </nova:ports>
Oct 25 23:04:10 user nova-compute[74507]:     </nova:instance>
Oct 25 23:04:10 user nova-compute[74507]:   </metadata>
Oct 25 23:04:10 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:04:10 user nova-compute[74507]:     <system>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="serial">d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</entry>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="uuid">d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</entry>
Oct 25 23:04:10 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:04:10 user nova-compute[74507]:     </system>
Oct 25 23:04:10 user nova-compute[74507]:   </sysinfo>
Oct 25 23:04:10 user nova-compute[74507]:   <os>
Oct 25 23:04:10 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:04:10 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:04:10 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:04:10 user nova-compute[74507]:   </os>
Oct 25 23:04:10 user nova-compute[74507]:   <features>
Oct 25 23:04:10 user nova-compute[74507]:     <acpi/>
Oct 25 23:04:10 user nova-compute[74507]:     <apic/>
Oct 25 23:04:10 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:04:10 user nova-compute[74507]:   </features>
Oct 25 23:04:10 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:04:10 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:04:10 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:04:10 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:04:10 user nova-compute[74507]:   </clock>
Oct 25 23:04:10 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:04:10 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:04:10 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:04:10 user nova-compute[74507]:   </cpu>
Oct 25 23:04:10 user nova-compute[74507]:   <devices>
Oct 25 23:04:10 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:04:10 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:04:10 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk"/>
Oct 25 23:04:10 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:04:10 user nova-compute[74507]:     </disk>
Oct 25 23:04:10 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:04:10 user nova-compute[74507]:       <mac address="fa:16:3e:be:4b:e3"/>
Oct 25 23:04:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:04:10 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:04:10 user nova-compute[74507]:       <target dev="tapf5d436ee-d7"/>
Oct 25 23:04:10 user nova-compute[74507]:     </interface>
Oct 25 23:04:10 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:04:10 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/console.log" append="off"/>
Oct 25 23:04:10 user nova-compute[74507]:     </serial>
Oct 25 23:04:10 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:04:10 user nova-compute[74507]:     <video>
Oct 25 23:04:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:04:10 user nova-compute[74507]:     </video>
Oct 25 23:04:10 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:04:10 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:04:10 user nova-compute[74507]:     </rng>
Oct 25 23:04:10 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:04:10 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:04:10 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:04:10 user nova-compute[74507]:     </memballoon>
Oct 25 23:04:10 user nova-compute[74507]:   </devices>
Oct 25 23:04:10 user nova-compute[74507]: </domain>
Oct 25 23:04:10 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdVqVEnG1tvrbE8SC8UEexV7JtUnUaATUT4JKZpKC/7naF7IKNc9ZOj10wlChq4N7oMMJekJPGsCLRq8r1MXq1sxSgiUa9LSykPcKGD9svl+P52qMBHvPmTptt8X86yyg==',key_name='tempest-keypair-2023587710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG os_vif [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fadb9f01-45bf-5ab0-85ad-e7ad44554684', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5d436ee-d7, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5d436ee-d7, col_values=(('qos', UUID('9ade6eb7-aefd-4fa0-81f7-5b5f5691abf5')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5d436ee-d7, col_values=(('external_ids', {'iface-id': 'f5d436ee-d7f9-42a7-ae52-646b1a57c6c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:4b:e3', 'vm-uuid': 'd7560741-7dcd-45bc-b9cb-aed2ffc5cf51'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:10 user nova-compute[74507]: INFO os_vif [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7')
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No VIF found with MAC fa:16:3e:be:4b:e3, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updated VIF entry in instance network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f78ec586-fee7-4e4c-8a74-216ae7feeffb req-dd342aed-6b66-49ae-9bf5-5c9f67b6f7c4 service nova] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:11 user nova-compute[74507]: WARNING nova.compute.manager [req-24502516-266f-47a4-b3e6-165c6812a22a req-a90f9d40-cde3-419a-860c-176537dfa56b service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state building and task_state spawning.
Oct 25 23:04:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:04:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance spawned successfully.
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:13 user nova-compute[74507]: WARNING nova.compute.manager [req-9cbdfaab-cb6e-4dbf-bd65-03466a044d1a req-acbed1dd-ac34-44b7-b1a7-c885754921d9 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state building and task_state spawning.
Oct 25 23:04:13 user nova-compute[74507]: INFO nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 25 23:04:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:04:14 user nova-compute[74507]: INFO nova.compute.manager [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Took 6.86 seconds to build instance.
Oct 25 23:04:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c75bb8b8-9dc6-4eff-a320-bf0e649c3b76 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.984s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:04:18 user nova-compute[74507]: INFO nova.compute.manager [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] instance snapshotting
Oct 25 23:04:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Beginning live snapshot process
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json -f qcow2 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece.delta 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece.delta 1073741824" returned: 0 in 0.055s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 23:04:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74507) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 23:04:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 23:04:21 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece.delta /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece.delta /opt/stack/data/nova/instances/snapshots/tmpygfen0sw/51ad2563340b4fd2b935e54c410ceece" returned: 0 in 0.616s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Snapshot extracted, beginning image upload
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:21 user nova-compute[74507]: INFO nova.compute.manager [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Terminating instance
Oct 25 23:04:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-874b0002-6fcc-442c-8907-4efbf8d64e0b req-a2424f6f-f57f-4924-8988-74e646b11a51 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-unplugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Instance destroyed successfully.
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'resources' on Instance uuid af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1903179898',display_name='tempest-ServerActionsTestOtherA-server-1903179898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1903179898',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-8t9fgqh6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "address": "fa:16:3e:1b:16:e5", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26964ed-5b", "ovs_interfaceid": "c26964ed-5bb7-4522-9569-b08e7b085ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_vif [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26964ed-5b, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e484478d-16be-4dcc-b00e-d1b5b12cb214) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:22 user nova-compute[74507]: INFO os_vif [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:16:e5,bridge_name='br-int',has_traffic_filtering=True,id=c26964ed-5bb7-4522-9569-b08e7b085ca9,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26964ed-5b')
Oct 25 23:04:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ieMhxYmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:04:22 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f2b5df-22c9-4b8c-8d65-c1365a90d875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:04:22 user nova-compute[74507]: No targets found.
Oct 25 23:04:22 user nova-compute[74507]: iSNS:
Oct 25 23:04:22 user nova-compute[74507]: No targets found.
Oct 25 23:04:22 user nova-compute[74507]: STATIC:
Oct 25 23:04:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886
Oct 25 23:04:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:04:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:04:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685
Oct 25 23:04:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:04:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:22 user nova-compute[74507]: FIRMWARE:
Oct 25 23:04:22 user nova-compute[74507]: No targets found.
Oct 25 23:04:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:04:22 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:04:22 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5f4c09-fb83-44b9-b162-3f6fcc28966a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7c2f71-7c98-4cda-ab3d-eefceabb5e74]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:04:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54476f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685'): ({'sdg'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Removing single pathed devices sdg {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:04:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2174be68-7d47-443d-b5fe-ee7604eeb9e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ab18b-a084-4fcc-8f99-bd31ef7354fe]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Flushing IO for device /dev/sdg {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383e149-9a0b-40a8-9ba7-553eafa91bea]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058ff55-a1b1-4357-a140-35bd8b58748b]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b25444-0f2b8bf68c82d197', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6b25444', '/dev/disk/by-id/scsi-23066326238626636') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690b362-bb20-4dfb-81d5-ef07d4931467]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ac5d6-9a2c-49c4-8600-8af39433d847]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d5a03-4ecb-4f97-8026-22ce55a878d4]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260]
Oct 25 23:04:23 user nova-compute[74507]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685, portal: 172.16.0.220,3260] successful.
Oct 25 23:04:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bbdff7-6227-498c-ae83-880aa183b685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156f94e-b5d3-421c-8e6a-6c1055e9d913]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] <== disconnect_volume: return (405ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:04:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Deleting instance files /opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e_del
Oct 25 23:04:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Deletion of /opt/stack/data/nova/instances/af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e_del complete
Oct 25 23:04:23 user nova-compute[74507]: INFO nova.compute.manager [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 25 23:04:23 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:04:23 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:04:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:24 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Took 0.96 seconds to deallocate network for instance.
Oct 25 23:04:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] Acquiring lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] No waiting events found dispatching network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:24 user nova-compute[74507]: WARNING nova.compute.manager [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received unexpected event network-vif-plugged-c26964ed-5bb7-4522-9569-b08e7b085ca9 for instance with vm_state active and task_state deleting.
Oct 25 23:04:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-346d49a2-e50a-473f-a717-29f574e0209a req-641fd7a0-d732-4d96-aa74-31a38a73a431 service nova] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Received event network-vif-deleted-c26964ed-5bb7-4522-9569-b08e7b085ca9 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Snapshot image upload complete
Oct 25 23:04:25 user nova-compute[74507]: INFO nova.compute.manager [None req-ebf0d6f8-3774-42c5-864c-4f5eacda7cb6 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Took 6.38 seconds to snapshot the instance on the hypervisor.
Oct 25 23:04:25 user nova-compute[74507]: INFO nova.compute.manager [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Took 1.16 seconds to detach 1 volumes for instance.
Oct 25 23:04:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e] Deleting volume: 87bbdff7-6227-498c-ae83-880aa183b685 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:04:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:26 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Deleted allocations for instance af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e
Oct 25 23:04:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-3c1e48eb-b049-481a-88b6-04b72ef08f9e tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "af5ce1bf-a1a0-44d7-9c38-27cfebf44a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.414s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing instance network info cache due to event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:04:26 user nova-compute[74507]: DEBUG nova.network.neutron [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updated VIF entry in instance network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-aabdd80d-73d0-4bbd-8926-f1d6be7acc59 req-9c3c5384-1894-4971-8a88-ade7cc648b41 service nova] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:27 user nova-compute[74507]: INFO nova.compute.manager [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Shelve offloading
Oct 25 23:04:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:28 user nova-compute[74507]: WARNING nova.compute.manager [req-63cc04b9-32c0-4e64-8ee6-8fc7166135d3 req-a07acb76-9066-43e6-9eec-a9772361c8c8 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state active and task_state shelving.
Oct 25 23:04:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance destroyed successfully.
Oct 25 23:04:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:04:30 user nova-compute[74507]: WARNING nova.compute.manager [req-bf3b8903-8a2e-4d58-816c-dddf53c0bad8 req-de2c6ea3-a7e3-49e3-8fc4-0cb45fee131b service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state active and task_state shelving.
Oct 25 23:04:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance destroyed successfully.
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.objects.instance [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'resources' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY4dqTZZtuKpbWuvSXuAGTGLKOG2AhqLGYVJbt3Wl/sbw9b8UrezvSYI5pDXPkJ408lc1u34VyvgKMURb0Ay/YPV7naGKRcgQJdLzcDGLabhGLdOAvtQ5TliD4/FK22Sg==',key_name='tempest-TestShelveInstance-585482898',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:03:21Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_vif [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c0e9752-77, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43079db6-20c9-40a8-878b-7da4a30e0b34) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:30 user nova-compute[74507]: INFO os_vif [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77')
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:04:30 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing instance network info cache due to event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf875483-34b9-4ad7-bdbf-cfaa6cd788c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:04:30 user nova-compute[74507]: No targets found.
Oct 25 23:04:30 user nova-compute[74507]: iSNS:
Oct 25 23:04:30 user nova-compute[74507]: No targets found.
Oct 25 23:04:30 user nova-compute[74507]: STATIC:
Oct 25 23:04:30 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886
Oct 25 23:04:30 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:30 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:30 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:04:30 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:30 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:30 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:04:30 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:30 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:30 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:04:30 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:04:30 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:04:30 user nova-compute[74507]: FIRMWARE:
Oct 25 23:04:30 user nova-compute[74507]: No targets found.
Oct 25 23:04:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:04:30 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:04:30 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ac518b-7969-4add-8af2-dc13c9befebf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce351490-b8e3-4bba-89c5-651a3561f44e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:04:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54475090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4413f5-1070-44c5-9fe8-bd3ee7a6dafe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcad88f-1030-4f4d-84fe-dc1336e72bfc]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a318d65-41a4-48dd-9676-c61208f34ba0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc2215-47d2-4750-9986-9e41e1719044]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c9c201-8efa-48ca-850e-a75522b01c38]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09da7f7-a656-4ca2-a05f-9e445298c515]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]
Oct 25 23:04:30 user nova-compute[74507]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.
Oct 25 23:04:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[564086c6-20df-487d-8f68-8cc19f51124e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== disconnect_volume: return (411ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:04:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deleting instance files /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6_del
Oct 25 23:04:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deletion of /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6_del complete
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updated VIF entry in instance network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": null, "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4c0e9752-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:04:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5a15101-d35f-428b-97e3-5dd43f58a726 req-88d7fb0f-ea63-4f9f-903b-61ff87498c6d service nova] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:04:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:32 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Deleted allocations for instance d3fd54be-06e8-4020-a67b-350a1c8f32c6
Oct 25 23:04:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG nova.objects.instance [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'numa_topology' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG nova.objects.base [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Object Instance<d3fd54be-06e8-4020-a67b-350a1c8f32c6> lazy-loaded attributes: resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-10e29333-5a50-4ec6-aae9-8980da538aef tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.814s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:38 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:40 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:04:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 23:04:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:04:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:04:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:04:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:04:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7932MB free_disk=24.91861343383789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d5a1f112-41ec-401b-858a-86f213d3003b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b79e0322-0c82-47ec-84b8-9943678f00d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:04:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:04:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:04:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:04:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:04:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:04:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:04:52 user nova-compute[74507]: INFO nova.compute.manager [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Detaching volume 56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:04:52 user nova-compute[74507]: INFO nova.virt.block_device [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Attempting to driver detach volume 56459313-10d8-41ab-b4a0-5aac10fd3d84 from mountpoint /dev/vdb
Oct 25 23:04:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Attempting to detach device vdb from instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:04:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:04:52 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:04:52 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 23:04:52 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:04:52 user nova-compute[74507]:   <serial>56459313-10d8-41ab-b4a0-5aac10fd3d84</serial>
Oct 25 23:04:52 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:04:52 user nova-compute[74507]: </disk>
Oct 25 23:04:52 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:04:52 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 from the persistent domain config.
Oct 25 23:04:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:04:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:04:52 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:04:52 user nova-compute[74507]:   <source dev="/dev/sde"/>
Oct 25 23:04:52 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:04:52 user nova-compute[74507]:   <serial>56459313-10d8-41ab-b4a0-5aac10fd3d84</serial>
Oct 25 23:04:52 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:04:52 user nova-compute[74507]: </disk>
Oct 25 23:04:52 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:04:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:04:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:00 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:05:00 user nova-compute[74507]: INFO nova.compute.claims [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Claim successful on node user
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:05:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.policy [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2bd439fd8ec46f89ab4dba1021525d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eb3fed6110e44d6ba6922cf016d07e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:05:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Creating image(s)
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "/opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "/opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG nova.virt.images [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] 98b833a6-f163-46a7-9a48-fdcfd893f52b was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.part /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Successfully created port: def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.part /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.converted" returned: 0 in 0.218s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.343s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Successfully updated port: def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-changed-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing instance network info cache due to event network-changed-def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36,backing_fmt=raw /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36,backing_fmt=raw /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk 1073741824" returned: 0 in 0.057s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "37e5c1914c623ee74e1cca68c1b11b07324a5e36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance network_info: |[{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing network info cache for port def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Cannot resize image /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Ensure instance console log exists: /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Start _get_guest_xml network_info=[{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T23:04:58Z,direct_url=<?>,disk_format='qcow2',id=98b833a6-f163-46a7-9a48-fdcfd893f52b,min_disk=0,min_ram=0,name='tempest-scenario-img--1887715004',owner='9eb3fed6110e44d6ba6922cf016d07e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T23:05:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '98b833a6-f163-46a7-9a48-fdcfd893f52b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:05:03 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:03 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T23:04:58Z,direct_url=<?>,disk_format='qcow2',id=98b833a6-f163-46a7-9a48-fdcfd893f52b,min_disk=0,min_ram=0,name='tempest-scenario-img--1887715004',owner='9eb3fed6110e44d6ba6922cf016d07e8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T23:05:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1900434321',display_name='tempest-TestMinimumBasicScenario-server-1900434321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1900434321',id=34,image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfsUG2/hbp0kWury4g+Bf5djfywQXFl/0qWVoXExYVLdPtok3WcZpvDkVrerb6G1v2sOVvI9nKa/jBBifi6lwrTkFEyCi64aOGPaYmASb3PelKHbObDB11qifJtHHe/Q==',key_name='tempest-TestMinimumBasicScenario-744159838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-cre922a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:01Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=eb4e946b-9ac6-49c7-809d-c2b15e0d8033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'pci_devices' on Instance uuid eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:05:03 user nova-compute[74507]:   <uuid>eb4e946b-9ac6-49c7-809d-c2b15e0d8033</uuid>
Oct 25 23:05:03 user nova-compute[74507]:   <name>instance-00000022</name>
Oct 25 23:05:03 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:05:03 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:05:03 user nova-compute[74507]:   <metadata>
Oct 25 23:05:03 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:05:03 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:name>tempest-TestMinimumBasicScenario-server-1900434321</nova:name>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:05:03</nova:creationTime>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:05:03 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:05:03 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:owner>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:user uuid="a2bd439fd8ec46f89ab4dba1021525d2">tempest-TestMinimumBasicScenario-1674517596-project-member</nova:user>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:project uuid="9eb3fed6110e44d6ba6922cf016d07e8">tempest-TestMinimumBasicScenario-1674517596</nova:project>
Oct 25 23:05:03 user nova-compute[74507]:       </nova:owner>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:root type="image" uuid="98b833a6-f163-46a7-9a48-fdcfd893f52b"/>
Oct 25 23:05:03 user nova-compute[74507]:       <nova:ports>
Oct 25 23:05:03 user nova-compute[74507]:         <nova:port uuid="def5828a-3040-4afc-9400-01d473d69921">
Oct 25 23:05:03 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 23:05:03 user nova-compute[74507]:         </nova:port>
Oct 25 23:05:03 user nova-compute[74507]:       </nova:ports>
Oct 25 23:05:03 user nova-compute[74507]:     </nova:instance>
Oct 25 23:05:03 user nova-compute[74507]:   </metadata>
Oct 25 23:05:03 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:05:03 user nova-compute[74507]:     <system>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="serial">eb4e946b-9ac6-49c7-809d-c2b15e0d8033</entry>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="uuid">eb4e946b-9ac6-49c7-809d-c2b15e0d8033</entry>
Oct 25 23:05:03 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:05:03 user nova-compute[74507]:     </system>
Oct 25 23:05:03 user nova-compute[74507]:   </sysinfo>
Oct 25 23:05:03 user nova-compute[74507]:   <os>
Oct 25 23:05:03 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:05:03 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:05:03 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:05:03 user nova-compute[74507]:   </os>
Oct 25 23:05:03 user nova-compute[74507]:   <features>
Oct 25 23:05:03 user nova-compute[74507]:     <acpi/>
Oct 25 23:05:03 user nova-compute[74507]:     <apic/>
Oct 25 23:05:03 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:05:03 user nova-compute[74507]:   </features>
Oct 25 23:05:03 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:05:03 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:05:03 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:05:03 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:05:03 user nova-compute[74507]:   </clock>
Oct 25 23:05:03 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:05:03 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:05:03 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:05:03 user nova-compute[74507]:   </cpu>
Oct 25 23:05:03 user nova-compute[74507]:   <devices>
Oct 25 23:05:03 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:05:03 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:05:03 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk"/>
Oct 25 23:05:03 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:05:03 user nova-compute[74507]:     </disk>
Oct 25 23:05:03 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:05:03 user nova-compute[74507]:       <mac address="fa:16:3e:02:e7:bd"/>
Oct 25 23:05:03 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:05:03 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:05:03 user nova-compute[74507]:       <target dev="tapdef5828a-30"/>
Oct 25 23:05:03 user nova-compute[74507]:     </interface>
Oct 25 23:05:03 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:05:03 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/console.log" append="off"/>
Oct 25 23:05:03 user nova-compute[74507]:     </serial>
Oct 25 23:05:03 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:05:03 user nova-compute[74507]:     <video>
Oct 25 23:05:03 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:05:03 user nova-compute[74507]:     </video>
Oct 25 23:05:03 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:05:03 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:05:03 user nova-compute[74507]:     </rng>
Oct 25 23:05:03 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:05:03 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:05:03 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:05:03 user nova-compute[74507]:     </memballoon>
Oct 25 23:05:03 user nova-compute[74507]:   </devices>
Oct 25 23:05:03 user nova-compute[74507]: </domain>
Oct 25 23:05:03 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1900434321',display_name='tempest-TestMinimumBasicScenario-server-1900434321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1900434321',id=34,image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfsUG2/hbp0kWury4g+Bf5djfywQXFl/0qWVoXExYVLdPtok3WcZpvDkVrerb6G1v2sOVvI9nKa/jBBifi6lwrTkFEyCi64aOGPaYmASb3PelKHbObDB11qifJtHHe/Q==',key_name='tempest-TestMinimumBasicScenario-744159838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-cre922a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:01Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=eb4e946b-9ac6-49c7-809d-c2b15e0d8033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG os_vif [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b1e5d6d-3514-5121-bf6f-6a34dfb9be1e', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdef5828a-30, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdef5828a-30, col_values=(('qos', UUID('5c86b9ce-62e5-4f93-8840-9f507aba4d2a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdef5828a-30, col_values=(('external_ids', {'iface-id': 'def5828a-3040-4afc-9400-01d473d69921', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:e7:bd', 'vm-uuid': 'eb4e946b-9ac6-49c7-809d-c2b15e0d8033'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:03 user nova-compute[74507]: INFO os_vif [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30')
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:05:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No VIF found with MAC fa:16:3e:02:e7:bd, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:05:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated VIF entry in instance network info cache for port def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:05:04 user nova-compute[74507]: DEBUG nova.network.neutron [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b6ac8c7b-dad6-41ac-b2aa-459a6f0f62a0 req-c3cdc67a-e574-4903-ada3-4137bbc32ab4 service nova] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:05 user nova-compute[74507]: WARNING nova.compute.manager [req-952acef2-2821-461e-af3d-453df70fbf10 req-8b8fde05-1537-4150-8091-1fa69ce755e3 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state building and task_state spawning.
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:05:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance spawned successfully.
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:07 user nova-compute[74507]: INFO nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Took 6.35 seconds to spawn the instance on the hypervisor.
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:05:07 user nova-compute[74507]: INFO nova.compute.manager [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Took 7.11 seconds to build instance.
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:07 user nova-compute[74507]: WARNING nova.compute.manager [req-825e184d-4d23-4a99-94ee-882ef9ae0551 req-10366ff5-1cb3-458c-9c5a-6ccb05f2b77c service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state active and task_state None.
Oct 25 23:05:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f91c1303-4fd4-4d07-ad16-d542918fae06 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.215s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-changed-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Refreshing instance network info cache due to event network-changed-3a01894c-7488-4f97-b320-f414fae48176. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] Acquiring lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] Acquired lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Refreshing network info cache for port 3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updated VIF entry in instance network info cache for port 3a01894c-7488-4f97-b320-f414fae48176. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updating instance_info_cache with network_info: [{"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0ec206f-9c7d-456e-b1f6-bacb694c0206 req-b51130bd-c9e0-41c3-8f4a-5f9d3092e566 service nova] Releasing lock "refresh_cache-b79e0322-0c82-47ec-84b8-9943678f00d9" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:13 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 is timed out.
Oct 25 23:05:13 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1 from the live domain config.
Oct 25 23:05:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KHSypQDR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:05:13 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc04b30-6625-4915-bf3b-fc3123ca25f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:05:13 user nova-compute[74507]: No targets found.
Oct 25 23:05:13 user nova-compute[74507]: iSNS:
Oct 25 23:05:13 user nova-compute[74507]: No targets found.
Oct 25 23:05:13 user nova-compute[74507]: STATIC:
Oct 25 23:05:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:05:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:05:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:05:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:05:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:05:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:05:13 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84
Oct 25 23:05:13 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:05:13 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:05:13 user nova-compute[74507]: FIRMWARE:
Oct 25 23:05:13 user nova-compute[74507]: No targets found.
Oct 25 23:05:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:05:13 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:05:13 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88d033-fb83-4b0d-8344-e5ab532d1efc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa42e9d-d54d-4372-9474-3d9635875e77]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:13 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:05:13 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:13 user nova-compute[74507]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 (non-flash)
Oct 25 23:05:13 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5467b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b1d95-5bd6-421a-9c51-4561fda2efbb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d5d2ad-f9a1-4983-884a-83b08a89ae99]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48016eab-a8bb-41e7-9067-f0dfd4e01b1c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b12636-88de-45df-8f6b-f29db5d4cdc4]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2790ef-5a3d-4a74-9d94-6ff20f76b449]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd183ee6-5839-4499-b1bc-3802c177f05c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260]
Oct 25 23:05:13 user nova-compute[74507]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84, portal: 172.16.0.220,3260] successful.
Oct 25 23:05:13 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56459313-10d8-41ab-b4a0-5aac10fd3d84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[05667cf0-7d75-4c06-aa76-2ae4ade4a64f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== disconnect_volume: return (344ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:05:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-88361916-e6e5-4f12-b44c-71f43e5a102b tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.731s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:23 user nova-compute[74507]: INFO nova.compute.manager [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Terminating instance
Oct 25 23:05:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-unplugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] No waiting events found dispatching network-vif-unplugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-9c1fa9d0-17ff-4d0c-8d95-fdfc4e7cb954 req-f8ebd854-e9ba-43e1-93c1-7f4c74586233 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-unplugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:05:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Instance destroyed successfully.
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lazy-loading 'resources' on Instance uuid d5a1f112-41ec-401b-858a-86f213d3003b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:45:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-221105648',display_name='tempest-ServerActionsTestOtherA-server-221105648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-221105648',id=3,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZixCRHg/A3t4MUST9Uy6OL1JMvJxUXs61xnK3oNgVHqvS539vLL+cURjY+sVPU4OSXXywQdNXb9vL9Tunx07y6iVFgQKPeyRGkRwCNiRKJhTZGkIvDiWsOzNObh5ToHA==',key_name='tempest-keypair-438819025',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bae88be410b4835bd2e0470ed90a895',ramdisk_id='',reservation_id='r-706nzjuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1402899626',owner_user_name='tempest-ServerActionsTestOtherA-1402899626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40a2834cde90449e8067ae627d799836',uuid=d5a1f112-41ec-401b-858a-86f213d3003b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converting VIF {"id": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "address": "fa:16:3e:a6:f4:3a", "network": {"id": "c0694af3-2a58-44ca-a84a-9dad21c0955b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1856220504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0bae88be410b4835bd2e0470ed90a895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6121d5d-6d", "ovs_interfaceid": "a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG os_vif [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6121d5d-6d, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fad8fb90-6f6d-4926-9dca-849d5920c00e) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:24 user nova-compute[74507]: INFO os_vif [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f4:3a,bridge_name='br-int',has_traffic_filtering=True,id=a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b,network=Network(c0694af3-2a58-44ca-a84a-9dad21c0955b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6121d5d-6d')
Oct 25 23:05:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Deleting instance files /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b_del
Oct 25 23:05:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Deletion of /opt/stack/data/nova/instances/d5a1f112-41ec-401b-858a-86f213d3003b_del complete
Oct 25 23:05:24 user nova-compute[74507]: INFO nova.compute.manager [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:24 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Took 0.66 seconds to deallocate network for instance.
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d26aeb5e-9d3c-4f19-a6c3-8a5c7e5aa96f req-9e29b88e-eb72-47e9-bb68-5fbe251a3295 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-deleted-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.284s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:05:25 user nova-compute[74507]: INFO nova.compute.claims [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Claim successful on node user
Oct 25 23:05:25 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Deleted allocations for instance d5a1f112-41ec-401b-858a-86f213d3003b
Oct 25 23:05:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e2eb7835-3170-42b0-b231-9946bd46308b tempest-ServerActionsTestOtherA-1402899626 tempest-ServerActionsTestOtherA-1402899626-project-member] Lock "d5a1f112-41ec-401b-858a-86f213d3003b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:05:25 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:05:25 user nova-compute[74507]: INFO nova.virt.block_device [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Booting with volume snapshot 999e28b7-f1bf-46e4-974f-3cf360647bcf at /dev/vda
Oct 25 23:05:25 user nova-compute[74507]: DEBUG nova.policy [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] Acquiring lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] Lock "d5a1f112-41ec-401b-858a-86f213d3003b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] No waiting events found dispatching network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:26 user nova-compute[74507]: WARNING nova.compute.manager [req-1d4db0cb-e68e-43e5-ad0f-a3cd59450c7f req-96975f26-9c50-488d-92f9-02f1edfbe605 service nova] [instance: d5a1f112-41ec-401b-858a-86f213d3003b] Received unexpected event network-vif-plugged-a6121d5d-6d41-4cb0-a9ef-5d2c50985a3b for instance with vm_state deleted and task_state None.
Oct 25 23:05:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Successfully created port: be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:05:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Successfully updated port: be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-changed-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Refreshing instance network info cache due to event network-changed-be8536da-1fa4-4240-9088-7d1935223982. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] Acquiring lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updating instance_info_cache with network_info: [{"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Instance network_info: |[{"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] Acquired lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Refreshing network info cache for port be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:05:28 user nova-compute[74507]: INFO nova.compute.claims [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Claim successful on node user
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updated VIF entry in instance network info cache for port be8536da-1fa4-4240-9088-7d1935223982. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updating instance_info_cache with network_info: [{"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79c37f7f-ad39-4b9e-8501-26f7861ef52d req-0410d872-be37-4354-ba5b-8f4275f2fb77 service nova] Releasing lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:05:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:05:28 user nova-compute[74507]: DEBUG nova.policy [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4da245cae18d400ab7b8c787bfd10156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdf2550d504422686b0a2a829758690', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:05:28 user nova-compute[74507]: INFO nova.virt.block_device [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Booting with volume-backed-image 541b34fc-25d4-4dab-841b-3fd7e92cb423 at /dev/vda
Oct 25 23:05:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Successfully created port: adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Successfully updated port: adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-changed-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Refreshing instance network info cache due to event network-changed-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] Acquiring lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating instance_info_cache with network_info: [{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance network_info: |[{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] Acquired lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:30 user nova-compute[74507]: DEBUG nova.network.neutron [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Refreshing network info cache for port adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.utils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef74ec1c-1751-40c1-890e-89286ad8ade9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbd6b91-fe56-4fe1-99e3-59ae02666e8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bed929-ab33-457f-a87b-3ae45c8d1218]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f048d29-b862-4a4c-a243-0e44cc99ac67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:05:31 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[358d70fb-1f21-4ba0-b350-4ae7d8f7122e]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG os_brick.utils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updating existing volume attachment record: 6343861a-5038-4ffe-b96f-ee5939109f63 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updated VIF entry in instance network info cache for port adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating instance_info_cache with network_info: [{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-50b4827f-6a5c-4982-921d-c156085b9d10 req-abb1dbae-a451-44b4-9a08-7726328e36a7 service nova] Releasing lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:39 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:05:42 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:43 user nova-compute[74507]: INFO nova.compute.manager [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Terminating instance
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-unplugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] No waiting events found dispatching network-vif-unplugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-f79d9ef4-c963-4723-8fe2-77a855895975 req-c17a30dd-5f00-44dd-bc73-98aa6b6498c5 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-unplugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:05:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Instance destroyed successfully.
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'resources' on Instance uuid 987398c5-0ff2-4280-bfcb-e24f2c839aa1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1206958500',display_name='tempest-AttachVolumeNegativeTest-server-1206958500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1206958500',id=28,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6w2pVOJyT41d1O9gMl/m3iCS460zvW36eVls8xYsxQIQtspV03INDeNptL8NQGGAQ5/cmzKlP/JUPcrr+h3YaYQxfAMWHwS3q99KX3TP9RfhG85sDU9ziyGLNDki2STw==',key_name='tempest-keypair-661284452',keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:59:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-affdvyrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=987398c5-0ff2-4280-bfcb-e24f2c839aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "address": "fa:16:3e:f7:be:f5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape617056b-f3", "ovs_interfaceid": "e617056b-f3a5-4bd5-a5c5-717a0870bb03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG os_vif [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape617056b-f3, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bb9ca87-013b-4ff5-9b4c-792d0533b94c) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:43 user nova-compute[74507]: INFO os_vif [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:be:f5,bridge_name='br-int',has_traffic_filtering=True,id=e617056b-f3a5-4bd5-a5c5-717a0870bb03,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape617056b-f3')
Oct 25 23:05:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Deleting instance files /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1_del
Oct 25 23:05:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Deletion of /opt/stack/data/nova/instances/987398c5-0ff2-4280-bfcb-e24f2c839aa1_del complete
Oct 25 23:05:43 user nova-compute[74507]: INFO nova.compute.manager [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 23:05:43 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:05:43 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:44 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Took 0.86 seconds to deallocate network for instance.
Oct 25 23:05:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.utils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83ad5a0-655a-44f0-b810-29332f5eaf2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fce301-c724-4bb9-8e56-15040fb4e5ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79301fa3-a697-4d27-8a46-e2d5fc5e2749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8437079-e678-4aff-a0f6-c863fa8afe05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:05:45 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[928351c6-02b2-4c26-8e5e-8d725e7a92dc]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG os_brick.utils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating existing volume attachment record: bf97553b-c61b-47bc-9c46-0f6af5a6f013 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:45 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Deleted allocations for instance 987398c5-0ff2-4280-bfcb-e24f2c839aa1
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] Acquiring lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] No waiting events found dispatching network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:45 user nova-compute[74507]: WARNING nova.compute.manager [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received unexpected event network-vif-plugged-e617056b-f3a5-4bd5-a5c5-717a0870bb03 for instance with vm_state deleted and task_state None.
Oct 25 23:05:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-838082ac-1d33-4631-8c36-a8d2aaddbe75 req-7011cb70-7b2d-42ba-947a-a9e74af27001 service nova] [instance: 987398c5-0ff2-4280-bfcb-e24f2c839aa1] Received event network-vif-deleted-e617056b-f3a5-4bd5-a5c5-717a0870bb03 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4172e1ab-63e8-4162-9519-064d2c550f7f tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "987398c5-0ff2-4280-bfcb-e24f2c839aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:45 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:47 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8066MB free_disk=24.912853240966797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b79e0322-0c82-47ec-84b8-9943678f00d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 767bfa5f-b93d-464a-847f-1838a6e5ed66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:05:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:05:51 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Creating image(s)
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Ensure instance console log exists: /opt/stack/data/nova/instances/767bfa5f-b93d-464a-847f-1838a6e5ed66/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Start _get_guest_xml network_info=[{"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T23:05:12Z,direct_url=<?>,disk_format='qcow2',id=4ed02d11-1e7a-454a-9ee7-9a91e94edc46,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2057522454',owner='3871b32ffb3648b3b8101a0674f89bd4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T23:05:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6343861a-5038-4ffe-b96f-ee5939109f63', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIZzyidp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '767bfa5f-b93d-464a-847f-1838a6e5ed66', 'attached_at': '', 'detached_at': '', 'volume_id': '0c8e3599-063a-4643-b1d6-32483bd3add2', 'serial': '0c8e3599-063a-4643-b1d6-32483bd3add2'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:05:51 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:51 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T23:05:12Z,direct_url=<?>,disk_format='qcow2',id=4ed02d11-1e7a-454a-9ee7-9a91e94edc46,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2057522454',owner='3871b32ffb3648b3b8101a0674f89bd4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T23:05:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIZzyidp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:05:51 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:05:51 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:05:51 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999e02d-3e42-46c4-bf3f-3adc220d1b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:05:51 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[287131a0-ebe3-4d73-9538-2dd12d132d72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2] added
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[557cfde5-63c8-4234-8f68-f8d0144df074]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a720669-94a6-490a-a880-61352f493e41]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIZzyidp {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIZzyidp" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14befa9b-2b90-4667-a3a7-b521803b079f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PIZzyidp'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe0fc8-a0cd-481a-a5a1-cd3e6af99fba]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3cb5c-feb0-43da-a8dd-0f46375218d8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8b365-46eb-465f-96cc-6eca98117fd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260]
Oct 25 23:05:51 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260] successful.
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d531acb-2607-432f-add1-209ef604164b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5dc60b-3b64-4d0d-964b-89ec5156c841]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:05:51 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9403f-cdab-465b-bc79-f2bff9f0c4a5]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:05:51 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIZzyidp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26536383362633361', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536383362633361', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2142925262',id=35,image_ref='4ed02d11-1e7a-454a-9ee7-9a91e94edc46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCfqgV1Wa4y+LOvOANiJXZpfAMRQLu9DkrsGIezPNM4czf1SdNvt75/YdJr+lm9cvn4WuxdI6L1HfETVc/Sbvi7T50VqJQePop1A4+3zYMQ3S7R5+CVNNi59Q12/w89iQ==',key_name='tempest-keypair-1071516741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-uicajv47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1389668605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=767bfa5f-b93d-464a-847f-1838a6e5ed66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid 767bfa5f-b93d-464a-847f-1838a6e5ed66 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:05:52 user nova-compute[74507]:   <uuid>767bfa5f-b93d-464a-847f-1838a6e5ed66</uuid>
Oct 25 23:05:52 user nova-compute[74507]:   <name>instance-00000023</name>
Oct 25 23:05:52 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:05:52 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:05:52 user nova-compute[74507]:   <metadata>
Oct 25 23:05:52 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:05:52 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2142925262</nova:name>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:05:51</nova:creationTime>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:05:52 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:05:52 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:owner>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 23:05:52 user nova-compute[74507]:       </nova:owner>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:root type="image" uuid="4ed02d11-1e7a-454a-9ee7-9a91e94edc46"/>
Oct 25 23:05:52 user nova-compute[74507]:       <nova:ports>
Oct 25 23:05:52 user nova-compute[74507]:         <nova:port uuid="be8536da-1fa4-4240-9088-7d1935223982">
Oct 25 23:05:52 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 23:05:52 user nova-compute[74507]:         </nova:port>
Oct 25 23:05:52 user nova-compute[74507]:       </nova:ports>
Oct 25 23:05:52 user nova-compute[74507]:     </nova:instance>
Oct 25 23:05:52 user nova-compute[74507]:   </metadata>
Oct 25 23:05:52 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:05:52 user nova-compute[74507]:     <system>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="serial">767bfa5f-b93d-464a-847f-1838a6e5ed66</entry>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="uuid">767bfa5f-b93d-464a-847f-1838a6e5ed66</entry>
Oct 25 23:05:52 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:05:52 user nova-compute[74507]:     </system>
Oct 25 23:05:52 user nova-compute[74507]:   </sysinfo>
Oct 25 23:05:52 user nova-compute[74507]:   <os>
Oct 25 23:05:52 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:05:52 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:05:52 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:05:52 user nova-compute[74507]:   </os>
Oct 25 23:05:52 user nova-compute[74507]:   <features>
Oct 25 23:05:52 user nova-compute[74507]:     <acpi/>
Oct 25 23:05:52 user nova-compute[74507]:     <apic/>
Oct 25 23:05:52 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:05:52 user nova-compute[74507]:   </features>
Oct 25 23:05:52 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:05:52 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:05:52 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:05:52 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:05:52 user nova-compute[74507]:   </clock>
Oct 25 23:05:52 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:05:52 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:05:52 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:05:52 user nova-compute[74507]:   </cpu>
Oct 25 23:05:52 user nova-compute[74507]:   <devices>
Oct 25 23:05:52 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:05:52 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:05:52 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 23:05:52 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:05:52 user nova-compute[74507]:       <serial>0c8e3599-063a-4643-b1d6-32483bd3add2</serial>
Oct 25 23:05:52 user nova-compute[74507]:     </disk>
Oct 25 23:05:52 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:05:52 user nova-compute[74507]:       <mac address="fa:16:3e:4c:84:c3"/>
Oct 25 23:05:52 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:05:52 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:05:52 user nova-compute[74507]:       <target dev="tapbe8536da-1f"/>
Oct 25 23:05:52 user nova-compute[74507]:     </interface>
Oct 25 23:05:52 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:05:52 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/767bfa5f-b93d-464a-847f-1838a6e5ed66/console.log" append="off"/>
Oct 25 23:05:52 user nova-compute[74507]:     </serial>
Oct 25 23:05:52 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:05:52 user nova-compute[74507]:     <video>
Oct 25 23:05:52 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:05:52 user nova-compute[74507]:     </video>
Oct 25 23:05:52 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:05:52 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:05:52 user nova-compute[74507]:     </rng>
Oct 25 23:05:52 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:05:52 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:05:52 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:05:52 user nova-compute[74507]:     </memballoon>
Oct 25 23:05:52 user nova-compute[74507]:   </devices>
Oct 25 23:05:52 user nova-compute[74507]: </domain>
Oct 25 23:05:52 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2142925262',id=35,image_ref='4ed02d11-1e7a-454a-9ee7-9a91e94edc46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCfqgV1Wa4y+LOvOANiJXZpfAMRQLu9DkrsGIezPNM4czf1SdNvt75/YdJr+lm9cvn4WuxdI6L1HfETVc/Sbvi7T50VqJQePop1A4+3zYMQ3S7R5+CVNNi59Q12/w89iQ==',key_name='tempest-keypair-1071516741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-uicajv47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1389668605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=767bfa5f-b93d-464a-847f-1838a6e5ed66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG os_vif [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb1f1cdf-d771-5d34-a8c1-e88e1bc9e180', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe8536da-1f, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe8536da-1f, col_values=(('qos', UUID('d0bf5476-a441-4341-8d40-c36991e00297')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe8536da-1f, col_values=(('external_ids', {'iface-id': 'be8536da-1fa4-4240-9088-7d1935223982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:84:c3', 'vm-uuid': '767bfa5f-b93d-464a-847f-1838a6e5ed66'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:52 user nova-compute[74507]: INFO os_vif [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f')
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:05:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:4c:84:c3, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] No waiting events found dispatching network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:54 user nova-compute[74507]: WARNING nova.compute.manager [req-d64297e2-7568-40c5-873d-ed1ac4271952 req-7e1b02ed-b899-45e6-8594-77ee60c60f8f service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received unexpected event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 for instance with vm_state building and task_state spawning.
Oct 25 23:05:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:05:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Instance spawned successfully.
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:05:56 user nova-compute[74507]: INFO nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:05:56 user nova-compute[74507]: INFO nova.compute.manager [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Took 31.44 seconds to build instance.
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] No waiting events found dispatching network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:05:56 user nova-compute[74507]: WARNING nova.compute.manager [req-264b9ddb-4e4e-47b5-b5c9-851077c7e1f8 req-52dddef2-88c5-4742-a37d-7917534e5925 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received unexpected event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 for instance with vm_state active and task_state None.
Oct 25 23:05:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f5af951-c7b8-49bc-adc6-1664e60eacae tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.548s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:05:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:05:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing instance network info cache due to event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updated VIF entry in instance network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG nova.network.neutron [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:05:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-119ce4e4-d565-4432-bb1a-3175f5c11b5e req-975eebdc-a7a6-4dd2-b284-a652fa768448 service nova] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:06:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Creating image(s)
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Ensure instance console log exists: /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start _get_guest_xml network_info=[{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bf97553b-c61b-47bc-9c46-0f6af5a6f013', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfaca483-bad0-4b7e-a6cf-74998913ba30', 'attached_at': '', 'detached_at': '', 'volume_id': '4677aa72-1371-449a-814d-a2e9acd25604', 'serial': '4677aa72-1371-449a-814d-a2e9acd25604'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:06:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:06:05 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:06:05 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:06:05 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77618c9c-955d-45cd-97aa-a21b741044e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:06:05 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8bccf3-7e3f-47b8-b777-5493813e1487]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604] added
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e04c3-d405-4b01-9f8c-3ba55d52197f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe3379-cfdd-46f1-a18e-66f943cfd383]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozKFfWLq {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozKFfWLq" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9de014-143a-40c6-96cb-18d44453b4cc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozKFfWLq'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c863665-bb92-43b5-8e9f-2a8d03f8756b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[824ea2ec-401a-46d2-8340-5388ffebb0f7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:05 user nova-compute[74507]: INFO nova.compute.manager [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Shelving
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[942e74b5-e284-46e5-a4ca-bdcbcf374b4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260]
Oct 25 23:06:05 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260] successful.
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a70ecd-f263-427b-9edd-deeee3485cbc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17c38e-4c3a-4fba-ac09-0569d20b8aa3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805f655-72f4-4538-b98d-1bb98643abbb]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:05 user nova-compute[74507]: WARNING nova.compute.manager [req-6750e067-523b-4334-a238-74114a86cf49 req-4e5a78f2-855e-437f-9d1a-255cf23c183d service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state active and task_state shelving.
Oct 25 23:06:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance destroyed successfully.
Oct 25 23:06:06 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Beginning cold snapshot process
Oct 25 23:06:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23263626432303231', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263626432303231', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk /opt/stack/data/nova/instances/snapshots/tmp8wp0qzbf/b3375927a30e47b590ccd5c775271fc0 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1995183307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1995183307',id=36,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-0p3bx0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:29Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=bfaca483-bad0-4b7e-a6cf-74998913ba30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:06:06 user nova-compute[74507]:   <uuid>bfaca483-bad0-4b7e-a6cf-74998913ba30</uuid>
Oct 25 23:06:06 user nova-compute[74507]:   <name>instance-00000024</name>
Oct 25 23:06:06 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:06:06 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:06:06 user nova-compute[74507]:   <metadata>
Oct 25 23:06:06 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:06:06 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1995183307</nova:name>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:06:05</nova:creationTime>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:06:06 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:06:06 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:owner>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 23:06:06 user nova-compute[74507]:       </nova:owner>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:06:06 user nova-compute[74507]:       <nova:ports>
Oct 25 23:06:06 user nova-compute[74507]:         <nova:port uuid="adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d">
Oct 25 23:06:06 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 23:06:06 user nova-compute[74507]:         </nova:port>
Oct 25 23:06:06 user nova-compute[74507]:       </nova:ports>
Oct 25 23:06:06 user nova-compute[74507]:     </nova:instance>
Oct 25 23:06:06 user nova-compute[74507]:   </metadata>
Oct 25 23:06:06 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:06:06 user nova-compute[74507]:     <system>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="serial">bfaca483-bad0-4b7e-a6cf-74998913ba30</entry>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="uuid">bfaca483-bad0-4b7e-a6cf-74998913ba30</entry>
Oct 25 23:06:06 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:06:06 user nova-compute[74507]:     </system>
Oct 25 23:06:06 user nova-compute[74507]:   </sysinfo>
Oct 25 23:06:06 user nova-compute[74507]:   <os>
Oct 25 23:06:06 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:06:06 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:06:06 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:06:06 user nova-compute[74507]:   </os>
Oct 25 23:06:06 user nova-compute[74507]:   <features>
Oct 25 23:06:06 user nova-compute[74507]:     <acpi/>
Oct 25 23:06:06 user nova-compute[74507]:     <apic/>
Oct 25 23:06:06 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:06:06 user nova-compute[74507]:   </features>
Oct 25 23:06:06 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:06:06 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:06:06 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:06:06 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:06:06 user nova-compute[74507]:   </clock>
Oct 25 23:06:06 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:06:06 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:06:06 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:06:06 user nova-compute[74507]:   </cpu>
Oct 25 23:06:06 user nova-compute[74507]:   <devices>
Oct 25 23:06:06 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:06:06 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:06:06 user nova-compute[74507]:       <source dev="/dev/sde"/>
Oct 25 23:06:06 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:06:06 user nova-compute[74507]:       <serial>4677aa72-1371-449a-814d-a2e9acd25604</serial>
Oct 25 23:06:06 user nova-compute[74507]:     </disk>
Oct 25 23:06:06 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:06:06 user nova-compute[74507]:       <mac address="fa:16:3e:65:73:a9"/>
Oct 25 23:06:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:06 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:06:06 user nova-compute[74507]:       <target dev="tapadc810bd-8a"/>
Oct 25 23:06:06 user nova-compute[74507]:     </interface>
Oct 25 23:06:06 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:06:06 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/console.log" append="off"/>
Oct 25 23:06:06 user nova-compute[74507]:     </serial>
Oct 25 23:06:06 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:06:06 user nova-compute[74507]:     <video>
Oct 25 23:06:06 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:06 user nova-compute[74507]:     </video>
Oct 25 23:06:06 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:06:06 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:06:06 user nova-compute[74507]:     </rng>
Oct 25 23:06:06 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:06:06 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:06:06 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:06:06 user nova-compute[74507]:     </memballoon>
Oct 25 23:06:06 user nova-compute[74507]:   </devices>
Oct 25 23:06:06 user nova-compute[74507]: </domain>
Oct 25 23:06:06 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1995183307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1995183307',id=36,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-0p3bx0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:05:29Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=bfaca483-bad0-4b7e-a6cf-74998913ba30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG os_vif [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67ceede1-3a19-58b4-a76d-e4732d220a1d', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadc810bd-8a, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadc810bd-8a, col_values=(('qos', UUID('1a4e9f94-b5ee-4127-ba06-2e275cf9bfed')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadc810bd-8a, col_values=(('external_ids', {'iface-id': 'adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:73:a9', 'vm-uuid': 'bfaca483-bad0-4b7e-a6cf-74998913ba30'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:06:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:06 user nova-compute[74507]: INFO os_vif [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a')
Oct 25 23:06:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:65:73:a9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk /opt/stack/data/nova/instances/snapshots/tmp8wp0qzbf/b3375927a30e47b590ccd5c775271fc0" returned: 0 in 0.990s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Snapshot extracted, beginning image upload
Oct 25 23:06:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:07 user nova-compute[74507]: WARNING nova.compute.manager [req-6becb995-91f3-48d4-a61c-2cb7e42b996c req-cb2775fe-f003-4869-a7f6-1f2277767e8e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:08 user nova-compute[74507]: WARNING nova.compute.manager [req-27791f5d-5406-4da6-b315-8672c809af4c req-fe351e8a-e837-4b09-a94c-a1aedaf7bb67 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state building and task_state spawning.
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Snapshot image upload complete
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.compute.manager [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Shelve offloading
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance destroyed successfully.
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance spawned successfully.
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:10 user nova-compute[74507]: WARNING nova.compute.manager [req-0b4ce411-ba46-4107-9279-5097aae5bd4c req-4c6f8c99-5a62-4188-af2d-143e3cb3c9ee service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state building and task_state spawning.
Oct 25 23:06:10 user nova-compute[74507]: INFO nova.compute.manager [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Took 42.64 seconds to build instance.
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1b9391bb-5245-48f3-8995-5726040f7ca8 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.727s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance destroyed successfully.
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'resources' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdVqVEnG1tvrbE8SC8UEexV7JtUnUaATUT4JKZpKC/7naF7IKNc9ZOj10wlChq4N7oMMJekJPGsCLRq8r1MXq1sxSgiUa9LSykPcKGD9svl+P52qMBHvPmTptt8X86yyg==',key_name='tempest-keypair-2023587710',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T23:06:10.234460',shelved_host='user',shelved_image_id='9f74380f-e8d3-431f-874b-f9047fd42c01'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG os_vif [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5d436ee-d7, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ade6eb7-aefd-4fa0-81f7-5b5f5691abf5) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: INFO os_vif [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7')
Oct 25 23:06:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Deleting instance files /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51_del
Oct 25 23:06:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Deletion of /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51_del complete
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing instance network info cache due to event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:06:11 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Deleted allocations for instance d7560741-7dcd-45bc-b9cb-aed2ffc5cf51
Oct 25 23:06:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'numa_topology' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:11 user nova-compute[74507]: DEBUG nova.objects.base [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<d7560741-7dcd-45bc-b9cb-aed2ffc5cf51> lazy-loaded attributes: resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updated VIF entry in instance network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG nova.network.neutron [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0754dc7d-ae3a-4347-94af-fb7f2ca4c459 req-62ee5405-44e3-4d61-98d6-41c69a271703 service nova] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5064de97-7e3e-4095-b27f-7501b45ceed7 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.677s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:19 user nova-compute[74507]: INFO nova.compute.manager [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Unshelving
Oct 25 23:06:19 user nova-compute[74507]: INFO nova.virt.block_device [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Booting with volume f8e70df5-f915-45eb-bc53-d16c64500886 at /dev/vda
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.utils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3ef2d-b259-4d10-be01-9f695b271e99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab98411-f950-4b04-9339-d3735a929afb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f8e43e-0e9b-4d28-ae31-24bd23b6d2d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[51341906-252c-40eb-98bc-409af5dc666c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:19 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:06:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1defa110-5ae2-4f8c-ac52-757deb8a63d0]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG os_brick.utils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:06:19 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating existing volume attachment record: 8066bd20-7dae-4b46-8b1d-2bc9b7ce9189 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:06:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:06:37 user nova-compute[74507]: INFO nova.compute.claims [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Claim successful on node user
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:06:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.policy [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b65985ef3b8403da48b609e49da19db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63880132a8984ca2bdfb3e226b65a093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:06:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Creating image(s)
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk 1073741824" returned: 0 in 0.051s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Cannot resize image /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Ensure instance console log exists: /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Successfully created port: ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.objects.instance [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'pci_requests' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.objects.instance [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'numa_topology' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:06:39 user nova-compute[74507]: INFO nova.compute.claims [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Claim successful on node user
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Successfully updated port: ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquired lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-changed-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Refreshing instance network info cache due to event network-changed-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] Acquiring lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating instance_info_cache with network_info: [{"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Releasing lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Instance network_info: |[{"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] Acquired lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Refreshing network info cache for port ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Start _get_guest_xml network_info=[{"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499673683',display_name='tempest-AttachVolumeNegativeTest-server-1499673683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499673683',id=37,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWjUyFDVnj84MYbsbzN5W320VcUe3/g16By8M8VwAxJBIpyjvhZMrKoUCDI1aG4YP98XMvs+IDWEM9WqMw/Az1gd3IRe+gu/ugMO0/7qBIo0yPo3vIL73Z+ssMaBnWug==',key_name='tempest-keypair-1786163975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-zy3ia2kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=1d685c29-b491-47bd-aebd-ecd45d3bef5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:40 user nova-compute[74507]: INFO nova.network.neutron [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating port 4c0e9752-7776-4583-a467-68ac9bcf9c10 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:06:40 user nova-compute[74507]:   <uuid>1d685c29-b491-47bd-aebd-ecd45d3bef5b</uuid>
Oct 25 23:06:40 user nova-compute[74507]:   <name>instance-00000025</name>
Oct 25 23:06:40 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:06:40 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:06:40 user nova-compute[74507]:   <metadata>
Oct 25 23:06:40 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:06:40 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1499673683</nova:name>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:06:40</nova:creationTime>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:06:40 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:06:40 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:owner>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:user uuid="8b65985ef3b8403da48b609e49da19db">tempest-AttachVolumeNegativeTest-231270075-project-member</nova:user>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:project uuid="63880132a8984ca2bdfb3e226b65a093">tempest-AttachVolumeNegativeTest-231270075</nova:project>
Oct 25 23:06:40 user nova-compute[74507]:       </nova:owner>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:06:40 user nova-compute[74507]:       <nova:ports>
Oct 25 23:06:40 user nova-compute[74507]:         <nova:port uuid="ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf">
Oct 25 23:06:40 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 23:06:40 user nova-compute[74507]:         </nova:port>
Oct 25 23:06:40 user nova-compute[74507]:       </nova:ports>
Oct 25 23:06:40 user nova-compute[74507]:     </nova:instance>
Oct 25 23:06:40 user nova-compute[74507]:   </metadata>
Oct 25 23:06:40 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:06:40 user nova-compute[74507]:     <system>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="serial">1d685c29-b491-47bd-aebd-ecd45d3bef5b</entry>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="uuid">1d685c29-b491-47bd-aebd-ecd45d3bef5b</entry>
Oct 25 23:06:40 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:06:40 user nova-compute[74507]:     </system>
Oct 25 23:06:40 user nova-compute[74507]:   </sysinfo>
Oct 25 23:06:40 user nova-compute[74507]:   <os>
Oct 25 23:06:40 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:06:40 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:06:40 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:06:40 user nova-compute[74507]:   </os>
Oct 25 23:06:40 user nova-compute[74507]:   <features>
Oct 25 23:06:40 user nova-compute[74507]:     <acpi/>
Oct 25 23:06:40 user nova-compute[74507]:     <apic/>
Oct 25 23:06:40 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:06:40 user nova-compute[74507]:   </features>
Oct 25 23:06:40 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:06:40 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:06:40 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:06:40 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:06:40 user nova-compute[74507]:   </clock>
Oct 25 23:06:40 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:06:40 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:06:40 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:06:40 user nova-compute[74507]:   </cpu>
Oct 25 23:06:40 user nova-compute[74507]:   <devices>
Oct 25 23:06:40 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:06:40 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:06:40 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk"/>
Oct 25 23:06:40 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:06:40 user nova-compute[74507]:     </disk>
Oct 25 23:06:40 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:06:40 user nova-compute[74507]:       <mac address="fa:16:3e:76:80:33"/>
Oct 25 23:06:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:40 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:06:40 user nova-compute[74507]:       <target dev="tapef9b7ed8-80"/>
Oct 25 23:06:40 user nova-compute[74507]:     </interface>
Oct 25 23:06:40 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:06:40 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/console.log" append="off"/>
Oct 25 23:06:40 user nova-compute[74507]:     </serial>
Oct 25 23:06:40 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:06:40 user nova-compute[74507]:     <video>
Oct 25 23:06:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:40 user nova-compute[74507]:     </video>
Oct 25 23:06:40 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:06:40 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:06:40 user nova-compute[74507]:     </rng>
Oct 25 23:06:40 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:06:40 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:06:40 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:06:40 user nova-compute[74507]:     </memballoon>
Oct 25 23:06:40 user nova-compute[74507]:   </devices>
Oct 25 23:06:40 user nova-compute[74507]: </domain>
Oct 25 23:06:40 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499673683',display_name='tempest-AttachVolumeNegativeTest-server-1499673683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499673683',id=37,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWjUyFDVnj84MYbsbzN5W320VcUe3/g16By8M8VwAxJBIpyjvhZMrKoUCDI1aG4YP98XMvs+IDWEM9WqMw/Az1gd3IRe+gu/ugMO0/7qBIo0yPo3vIL73Z+ssMaBnWug==',key_name='tempest-keypair-1786163975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-zy3ia2kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:06:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=1d685c29-b491-47bd-aebd-ecd45d3bef5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG os_vif [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b063414d-f8e5-5f31-9ed2-dc41a839589b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef9b7ed8-80, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef9b7ed8-80, col_values=(('qos', UUID('7e2eb0b3-fb55-419f-89d3-8312245ad005')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef9b7ed8-80, col_values=(('external_ids', {'iface-id': 'ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:80:33', 'vm-uuid': '1d685c29-b491-47bd-aebd-ecd45d3bef5b'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:40 user nova-compute[74507]: INFO os_vif [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80')
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:76:80:33, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updated VIF entry in instance network info cache for port ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating instance_info_cache with network_info: [{"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7cfb9d0a-2dc9-4789-a869-259fd5124160 req-e82fecc4-fb8e-4660-9057-53a2ee4e1633 service nova] Releasing lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:40 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:06:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Creating image(s)
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Ensure instance console log exists: /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start _get_guest_xml network_info=[{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8066bd20-7dae-4b46-8b1d-2bc9b7ce9189', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3fd54be-06e8-4020-a67b-350a1c8f32c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8e70df5-f915-45eb-bc53-d16c64500886', 'serial': 'f8e70df5-f915-45eb-bc53-d16c64500886'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:41 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:41 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing instance network info cache due to event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:06:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.objects.instance [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.objects.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Object Instance<d3fd54be-06e8-4020-a67b-350a1c8f32c6> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:06:42 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:06:42 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:06:42 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[005df9fe-7001-418c-a77c-dbfd83fa9048]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:06:42 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6b7f0a-8b1e-4a9d-80fd-6cb77649013c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886] added
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a20957-8579-46da-8198-d020635b7113]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c819aa9-4ca8-4789-a0db-015017477afb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwZCGRvr {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwZCGRvr" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cedf978-fbf9-4073-a3ff-3320eae94f3c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwZCGRvr'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] No waiting events found dispatching network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:42 user nova-compute[74507]: WARNING nova.compute.manager [req-3c45c4c8-0562-4bf0-8dcc-a5f15d5102d8 req-fe272054-967b-4cf7-9a19-d1816fb401e4 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received unexpected event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf for instance with vm_state building and task_state spawning.
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[257be0dc-af2d-4d6e-aa25-02a993a60577]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f26c3-9bb8-49e0-b2b5-ff3034e83313]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[303527fb-c45f-447a-9069-61b2b6d07c29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]
Oct 25 23:06:42 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7a43d9-0cb0-4694-abfe-8612861cf914]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbff667d-e09c-4013-9548-e55e146be911]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:06:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5908b86-fbec-4ce5-9e0f-9c587202c681]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.network.neutron [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updated VIF entry in instance network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG nova.network.neutron [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-eb8b7981-a5e0-4cb2-8cde-88569d2167d0 req-97abba32-99bd-4d60-8a37-1144babbff58 service nova] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23331333034343263', 'path': '/dev/sdf'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331333034343263', 'path': '/dev/sdf'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-585482898',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:06:20Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'pci_devices' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.objects.base [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Object Instance<d3fd54be-06e8-4020-a67b-350a1c8f32c6> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:06:43 user nova-compute[74507]:   <uuid>d3fd54be-06e8-4020-a67b-350a1c8f32c6</uuid>
Oct 25 23:06:43 user nova-compute[74507]:   <name>instance-0000001f</name>
Oct 25 23:06:43 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:06:43 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:06:43 user nova-compute[74507]:   <metadata>
Oct 25 23:06:43 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:06:43 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:06:43 user nova-compute[74507]:       <nova:name>tempest-TestShelveInstance-server-1508559622</nova:name>
Oct 25 23:06:43 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:06:41</nova:creationTime>
Oct 25 23:06:43 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:06:43 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:06:43 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:06:43 user nova-compute[74507]:       <nova:owner>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:user uuid="bec0411e0f0e4e8f904477e0639d5491">tempest-TestShelveInstance-65908321-project-member</nova:user>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:project uuid="9b79f154615e40ce8c4ef955fb3be5ef">tempest-TestShelveInstance-65908321</nova:project>
Oct 25 23:06:43 user nova-compute[74507]:       </nova:owner>
Oct 25 23:06:43 user nova-compute[74507]:       <nova:ports>
Oct 25 23:06:43 user nova-compute[74507]:         <nova:port uuid="4c0e9752-7776-4583-a467-68ac9bcf9c10">
Oct 25 23:06:43 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 23:06:43 user nova-compute[74507]:         </nova:port>
Oct 25 23:06:43 user nova-compute[74507]:       </nova:ports>
Oct 25 23:06:43 user nova-compute[74507]:     </nova:instance>
Oct 25 23:06:43 user nova-compute[74507]:   </metadata>
Oct 25 23:06:43 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:06:43 user nova-compute[74507]:     <system>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="serial">d3fd54be-06e8-4020-a67b-350a1c8f32c6</entry>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="uuid">d3fd54be-06e8-4020-a67b-350a1c8f32c6</entry>
Oct 25 23:06:43 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:06:43 user nova-compute[74507]:     </system>
Oct 25 23:06:43 user nova-compute[74507]:   </sysinfo>
Oct 25 23:06:43 user nova-compute[74507]:   <os>
Oct 25 23:06:43 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:06:43 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:06:43 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:06:43 user nova-compute[74507]:   </os>
Oct 25 23:06:43 user nova-compute[74507]:   <features>
Oct 25 23:06:43 user nova-compute[74507]:     <acpi/>
Oct 25 23:06:43 user nova-compute[74507]:     <apic/>
Oct 25 23:06:43 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:06:43 user nova-compute[74507]:   </features>
Oct 25 23:06:43 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:06:43 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:06:43 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:06:43 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:06:43 user nova-compute[74507]:   </clock>
Oct 25 23:06:43 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:06:43 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:06:43 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:06:43 user nova-compute[74507]:   </cpu>
Oct 25 23:06:43 user nova-compute[74507]:   <devices>
Oct 25 23:06:43 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:06:43 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:06:43 user nova-compute[74507]:       <source dev="/dev/sdf"/>
Oct 25 23:06:43 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:06:43 user nova-compute[74507]:       <serial>f8e70df5-f915-45eb-bc53-d16c64500886</serial>
Oct 25 23:06:43 user nova-compute[74507]:     </disk>
Oct 25 23:06:43 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:06:43 user nova-compute[74507]:       <mac address="fa:16:3e:b2:ea:96"/>
Oct 25 23:06:43 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:43 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:06:43 user nova-compute[74507]:       <target dev="tap4c0e9752-77"/>
Oct 25 23:06:43 user nova-compute[74507]:     </interface>
Oct 25 23:06:43 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:06:43 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6/console.log" append="off"/>
Oct 25 23:06:43 user nova-compute[74507]:     </serial>
Oct 25 23:06:43 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:06:43 user nova-compute[74507]:     <video>
Oct 25 23:06:43 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:06:43 user nova-compute[74507]:     </video>
Oct 25 23:06:43 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:06:43 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:06:43 user nova-compute[74507]:     </rng>
Oct 25 23:06:43 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:06:43 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:06:43 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:06:43 user nova-compute[74507]:     </memballoon>
Oct 25 23:06:43 user nova-compute[74507]:   </devices>
Oct 25 23:06:43 user nova-compute[74507]: </domain>
Oct 25 23:06:43 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-585482898',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:03:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:06:20Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG os_vif [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9eb6c86b-4ddf-5fd6-87a4-b06e904a8751', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c0e9752-77, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c0e9752-77, col_values=(('qos', UUID('b7622177-150d-4379-a34d-43552a44c772')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c0e9752-77, col_values=(('external_ids', {'iface-id': '4c0e9752-7776-4583-a467-68ac9bcf9c10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ea:96', 'vm-uuid': 'd3fd54be-06e8-4020-a67b-350a1c8f32c6'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:43 user nova-compute[74507]: INFO os_vif [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77')
Oct 25 23:06:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] No VIF found with MAC fa:16:3e:b2:ea:96, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:43 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:06:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Instance spawned successfully.
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] No waiting events found dispatching network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:44 user nova-compute[74507]: WARNING nova.compute.manager [req-23aae582-5825-4cc0-ba23-2f18ccd0dd68 req-7182aa23-8bd8-482d-915b-ca453a12f097 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received unexpected event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf for instance with vm_state building and task_state spawning.
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:06:44 user nova-compute[74507]: INFO nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Took 6.52 seconds to spawn the instance on the hypervisor.
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:06:44 user nova-compute[74507]: INFO nova.compute.manager [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Took 7.48 seconds to build instance.
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4c41816a-d1ea-4bb2-92de-78e5981b59be tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.579s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:06:45 user nova-compute[74507]: INFO nova.compute.claims [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Claim successful on node user
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:06:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.policy [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8822d9d3b9cc4c1283631390d6b14b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30598a8d1f8543d7a59a4a824bacbe8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:06:46 user nova-compute[74507]: INFO nova.virt.block_device [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Booting with volume f0fce950-c37f-4bcc-9649-7d58a4fcebe2 at /dev/vda
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.utils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a71d1-957d-47f9-8ec1-761fc2f12781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605ad2b-05d0-42a6-a26b-3e647426f41c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0569ebdb-1653-4dca-8b44-d47bca1b9167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea5099a-7ec9-465e-b204-ddb6345bc5d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:46 user nova-compute[74507]: WARNING nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:06:46 user nova-compute[74507]: WARNING nova.compute.manager [req-e9def626-e5ac-415b-ba53-685aa2e6571e req-d4d1452f-ce1e-47f7-883b-8e7b917ffca2 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:46 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad9a90-e7a8-475e-9458-5c3d21d5ddd5]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG os_brick.utils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating existing volume attachment record: 4d5f2dc0-ce3f-4584-a175-523416ab707f {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:06:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Successfully created port: b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:06:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance spawned successfully.
Oct 25 23:06:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-064e4ef4-3a10-45fc-be80-d735e277411b tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.131s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:06:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Successfully updated port: b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquired lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-changed-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.compute.manager [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Refreshing instance network info cache due to event network-changed-b24478f9-98a5-4c98-af2f-a65350649a17. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] Acquiring lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating instance_info_cache with network_info: [{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Releasing lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance network_info: |[{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] Acquired lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.network.neutron [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Refreshing network info cache for port b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:06:49 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:49 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=24.876914978027344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b79e0322-0c82-47ec-84b8-9943678f00d9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 767bfa5f-b93d-464a-847f-1838a6e5ed66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d3fd54be-06e8-4020-a67b-350a1c8f32c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 66439d36-425e-43cd-a932-2ab553f840c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:06:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updated VIF entry in instance network info cache for port b24478f9-98a5-4c98-af2f-a65350649a17. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating instance_info_cache with network_info: [{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17ec9c9d-ba22-45b7-8272-71637fd3db78 req-bb27d349-dab6-4227-80dc-ff41bb473a88 service nova] Releasing lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:06:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:06:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:06:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:06:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:06:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:57 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:06:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:06:58 user nova-compute[74507]: INFO nova.compute.manager [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Attaching volume 35cb8abc-d9e3-4c5e-8129-cbb157a70c5e to /dev/vdb
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155a5bf-3508-4eb0-9125-e128aa628fd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b570706a-9581-4dcd-aabb-ded142b682b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a650c-8c70-47fa-9087-6f0560e2b5b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a7a4b-456e-477f-9b83-fb5d2f8248c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:06:58 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:06:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c4432-1dc4-4378-ab1c-b12696c4bc42]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating existing volume attachment record: 1135e84f-0323-446e-9b23-517e274e2151 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:06:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:07:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:07:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:07:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Creating image(s)
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Ensure instance console log exists: /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start _get_guest_xml network_info=[{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d5f2dc0-ce3f-4584-a175-523416ab707f', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66439d36-425e-43cd-a932-2ab553f840c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'serial': 'f0fce950-c37f-4bcc-9649-7d58a4fcebe2'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:07:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:07:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:07 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c5db0-8587-4899-81c3-b82c9ebc45b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:07:07 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea030d3-7345-4b83-aa53-213c5ef48ccd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2] added
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7986a-09a5-4f67-9dee-a69e94066e67]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710b073-fbcb-4352-9b62-1efc14b404d9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKMsXEdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKMsXEdg" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42264a6d-6729-488c-b33e-8830f9a0a370]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKMsXEdg'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d63de5-5970-4b27-bc26-707fd8348b10]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc96532-4330-4f62-93de-e25bdf2601fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e16da-51fa-4d27-b585-cf5e06f84357]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]
Oct 25 23:07:07 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb86141-2a6d-4db9-af8c-f0f12b6f0fd1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e858097-b628-47a2-bed4-3d2307bbf68f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dc76b-c6d5-480d-b596-48e2d24951c9]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23733643739653961', 'path': '/dev/sdg'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643739653961', 'path': '/dev/sdg'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1549329912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lazy-loading 'pci_devices' on Instance uuid 66439d36-425e-43cd-a932-2ab553f840c5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:07:08 user nova-compute[74507]:   <uuid>66439d36-425e-43cd-a932-2ab553f840c5</uuid>
Oct 25 23:07:08 user nova-compute[74507]:   <name>instance-00000026</name>
Oct 25 23:07:08 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:07:08 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:07:08 user nova-compute[74507]:   <metadata>
Oct 25 23:07:08 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:07:08 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:07:08 user nova-compute[74507]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1549329912</nova:name>
Oct 25 23:07:08 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:07:07</nova:creationTime>
Oct 25 23:07:08 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:07:08 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:07:08 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:07:08 user nova-compute[74507]:       <nova:owner>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:user uuid="8822d9d3b9cc4c1283631390d6b14b02">tempest-ServerActionsV293TestJSON-1930328480-project-member</nova:user>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:project uuid="30598a8d1f8543d7a59a4a824bacbe8f">tempest-ServerActionsV293TestJSON-1930328480</nova:project>
Oct 25 23:07:08 user nova-compute[74507]:       </nova:owner>
Oct 25 23:07:08 user nova-compute[74507]:       <nova:ports>
Oct 25 23:07:08 user nova-compute[74507]:         <nova:port uuid="b24478f9-98a5-4c98-af2f-a65350649a17">
Oct 25 23:07:08 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 23:07:08 user nova-compute[74507]:         </nova:port>
Oct 25 23:07:08 user nova-compute[74507]:       </nova:ports>
Oct 25 23:07:08 user nova-compute[74507]:     </nova:instance>
Oct 25 23:07:08 user nova-compute[74507]:   </metadata>
Oct 25 23:07:08 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:07:08 user nova-compute[74507]:     <system>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="serial">66439d36-425e-43cd-a932-2ab553f840c5</entry>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="uuid">66439d36-425e-43cd-a932-2ab553f840c5</entry>
Oct 25 23:07:08 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:07:08 user nova-compute[74507]:     </system>
Oct 25 23:07:08 user nova-compute[74507]:   </sysinfo>
Oct 25 23:07:08 user nova-compute[74507]:   <os>
Oct 25 23:07:08 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:07:08 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:07:08 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:07:08 user nova-compute[74507]:   </os>
Oct 25 23:07:08 user nova-compute[74507]:   <features>
Oct 25 23:07:08 user nova-compute[74507]:     <acpi/>
Oct 25 23:07:08 user nova-compute[74507]:     <apic/>
Oct 25 23:07:08 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:07:08 user nova-compute[74507]:   </features>
Oct 25 23:07:08 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:07:08 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:07:08 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:07:08 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:07:08 user nova-compute[74507]:   </clock>
Oct 25 23:07:08 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:07:08 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:07:08 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:07:08 user nova-compute[74507]:   </cpu>
Oct 25 23:07:08 user nova-compute[74507]:   <devices>
Oct 25 23:07:08 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:07:08 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:07:08 user nova-compute[74507]:       <source dev="/dev/sdg"/>
Oct 25 23:07:08 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:07:08 user nova-compute[74507]:       <serial>f0fce950-c37f-4bcc-9649-7d58a4fcebe2</serial>
Oct 25 23:07:08 user nova-compute[74507]:     </disk>
Oct 25 23:07:08 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:07:08 user nova-compute[74507]:       <mac address="fa:16:3e:af:b4:f8"/>
Oct 25 23:07:08 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:07:08 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:07:08 user nova-compute[74507]:       <target dev="tapb24478f9-98"/>
Oct 25 23:07:08 user nova-compute[74507]:     </interface>
Oct 25 23:07:08 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:07:08 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5/console.log" append="off"/>
Oct 25 23:07:08 user nova-compute[74507]:     </serial>
Oct 25 23:07:08 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:07:08 user nova-compute[74507]:     <video>
Oct 25 23:07:08 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:07:08 user nova-compute[74507]:     </video>
Oct 25 23:07:08 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:07:08 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:07:08 user nova-compute[74507]:     </rng>
Oct 25 23:07:08 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:07:08 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:07:08 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:07:08 user nova-compute[74507]:     </memballoon>
Oct 25 23:07:08 user nova-compute[74507]:   </devices>
Oct 25 23:07:08 user nova-compute[74507]: </domain>
Oct 25 23:07:08 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1549329912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:06:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG os_vif [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2ef0b3d-f2df-5541-9da3-b99e06d4eed6', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24478f9-98, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb24478f9-98, col_values=(('qos', UUID('03685498-1926-4639-914d-933f0fdd4546')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb24478f9-98, col_values=(('external_ids', {'iface-id': 'b24478f9-98a5-4c98-af2f-a65350649a17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:b4:f8', 'vm-uuid': '66439d36-425e-43cd-a932-2ab553f840c5'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:08 user nova-compute[74507]: INFO os_vif [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98')
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:07:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] No VIF found with MAC fa:16:3e:af:b4:f8, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:10 user nova-compute[74507]: WARNING nova.compute.manager [req-2b40075e-03e6-4aad-b790-89cacb12b4d7 req-394bb5a9-7a03-4b5b-9af2-3e36b172cdf3 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state building and task_state spawning.
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:07:12 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance spawned successfully.
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:12 user nova-compute[74507]: WARNING nova.compute.manager [req-253a52bf-4819-46d8-a24c-5fe61c9ea6c9 req-38b24589-a80e-4d24-99fd-3b32a02c157c service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state building and task_state spawning.
Oct 25 23:07:12 user nova-compute[74507]: INFO nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 25 23:07:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:07:12 user nova-compute[74507]: INFO nova.compute.manager [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Took 27.38 seconds to build instance.
Oct 25 23:07:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e1f3ed66-5e81-4ac5-b0db-40e99e71a472 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.520s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-changed-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Refreshing instance network info cache due to event network-changed-be8536da-1fa4-4240-9088-7d1935223982. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] Acquiring lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] Acquired lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Refreshing network info cache for port be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updated VIF entry in instance network info cache for port be8536da-1fa4-4240-9088-7d1935223982. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updating instance_info_cache with network_info: [{"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1ebee678-3d10-45d6-ab9b-fe739e12cd16 req-c2cf075c-7e09-4fe3-b4ae-d7a86e272934 service nova] Releasing lock "refresh_cache-767bfa5f-b93d-464a-847f-1838a6e5ed66" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:16 user nova-compute[74507]: INFO nova.compute.manager [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Terminating instance
Oct 25 23:07:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-unplugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] No waiting events found dispatching network-vif-unplugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-49b8d1fd-08ce-453d-b0fd-591c27db14a2 req-1285ed47-533a-4a8e-8f77-cc0ea0773a69 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-unplugged-be8536da-1fa4-4240-9088-7d1935223982 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Instance destroyed successfully.
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.objects.instance [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid 767bfa5f-b93d-464a-847f-1838a6e5ed66 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2142925262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2142925262',id=35,image_ref='4ed02d11-1e7a-454a-9ee7-9a91e94edc46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCfqgV1Wa4y+LOvOANiJXZpfAMRQLu9DkrsGIezPNM4czf1SdNvt75/YdJr+lm9cvn4WuxdI6L1HfETVc/Sbvi7T50VqJQePop1A4+3zYMQ3S7R5+CVNNi59Q12/w89iQ==',key_name='tempest-keypair-1071516741',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:05:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-uicajv47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1389668605',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=767bfa5f-b93d-464a-847f-1838a6e5ed66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "be8536da-1fa4-4240-9088-7d1935223982", "address": "fa:16:3e:4c:84:c3", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8536da-1f", "ovs_interfaceid": "be8536da-1fa4-4240-9088-7d1935223982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_vif [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe8536da-1f, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0bf5476-a441-4341-8d40-c36991e00297) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:17 user nova-compute[74507]: INFO os_vif [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:84:c3,bridge_name='br-int',has_traffic_filtering=True,id=be8536da-1fa4-4240-9088-7d1935223982,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8536da-1f')
Oct 25 23:07:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIZzyidp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:07:17 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb1d1c3-3f03-48f2-8ce5-937a05247534]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:07:17 user nova-compute[74507]: No targets found.
Oct 25 23:07:17 user nova-compute[74507]: iSNS:
Oct 25 23:07:17 user nova-compute[74507]: No targets found.
Oct 25 23:07:17 user nova-compute[74507]: STATIC:
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2
Oct 25 23:07:17 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:07:17 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:07:17 user nova-compute[74507]: FIRMWARE:
Oct 25 23:07:17 user nova-compute[74507]: No targets found.
Oct 25 23:07:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:07:17 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:07:17 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe68fb-18da-4717-ad31-1860f69fdf58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b72a82f-8e45-46cb-a4d3-af45493b14fe]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b545a9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[859beee2-ae69-4ff3-9cb6-2cf123690e5f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab60f86-f67f-47b6-a466-c41e3425a3b8]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aff995-99f9-42c2-8794-95a4af0ee748]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db728e92-4675-4e35-a022-d6167d439a7e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26536383362633361', '/dev/disk/by-id/scsi-1SCST_BIO2026ef4d-e683bc3a5b0c872c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2026ef4d') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2808fe-233a-4035-9404-0000fd988001]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[68adfa78-43b1-49ff-a040-e2ebe7b7a59f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad7ebe-9a7c-4e95-8c1f-6d0218ca29aa]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260]
Oct 25 23:07:18 user nova-compute[74507]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2, portal: 172.16.0.220,3260] successful.
Oct 25 23:07:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c8e3599-063a-4643-b1d6-32483bd3add2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8c0e7-3382-4497-9c91-d3ac707aa372]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (406ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:07:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Deleting instance files /opt/stack/data/nova/instances/767bfa5f-b93d-464a-847f-1838a6e5ed66_del
Oct 25 23:07:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Deletion of /opt/stack/data/nova/instances/767bfa5f-b93d-464a-847f-1838a6e5ed66_del complete
Oct 25 23:07:18 user nova-compute[74507]: INFO nova.compute.manager [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQRMpxoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:07:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:18 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc3596f-cc5f-4a4c-b18a-4a40fb14b076]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:07:18 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5528e-1e01-465f-9d6c-13d878f01953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e] added
Oct 25 23:07:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.100s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a050133-058b-4f8b-8679-e0fc2d4a060f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca53ed-6754-4f7c-a8a5-1ed6218b7823]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQRMpxoO {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQRMpxoO" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770d132-2ed8-41e8-b259-f94f04389a51]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQRMpxoO'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bc67b-1431-4845-9e15-a0ad9703a7a2]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d59102-11a7-422b-8842-1517651c51de]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: INFO nova.compute.manager [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Rescuing
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53fb393-7a3c-47a3-8b56-a866bbf7fbae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260]
Oct 25 23:07:19 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260] successful.
Oct 25 23:07:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a75193-33f5-4f56-9759-751ec882ac3e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee641e6-6268-431e-a062-4d990f1ad6ac]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:07:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:19 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:07:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] Acquiring lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] No waiting events found dispatching network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:19 user nova-compute[74507]: WARNING nova.compute.manager [req-3a150e45-e239-4816-bfd7-3bcaae525bb2 req-95f10a2f-8298-48aa-ba6c-cf2d68743451 service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received unexpected event network-vif-plugged-be8536da-1fa4-4240-9088-7d1935223982 for instance with vm_state active and task_state deleting.
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:19 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Took 1.06 seconds to deallocate network for instance.
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b988d00-bf1b-47b2-a33a-969d6c13cce8]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating instance_info_cache with network_info: [{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:20 user nova-compute[74507]: WARNING nova.compute.manager [req-40ce476c-54c7-4334-882c-45ee41ed3277 req-8223d115-9f80-45a7-acef-a3433d74a78d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state active and task_state rescuing.
Oct 25 23:07:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQRMpxoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '26637636131393232', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637636131393232', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:07:20 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:07:20 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:07:20 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:07:20 user nova-compute[74507]:   <serial>35cb8abc-d9e3-4c5e-8129-cbb157a70c5e</serial>
Oct 25 23:07:20 user nova-compute[74507]: </disk>
Oct 25 23:07:20 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:07:20 user nova-compute[74507]: INFO nova.compute.manager [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Took 1.18 seconds to detach 1 volumes for instance.
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Deleting volume: 0c8e3599-063a-4643-b1d6-32483bd3add2 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance destroyed successfully.
Oct 25 23:07:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Attempting a stable device rescue
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74507) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance directory exists: not creating {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 23:07:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Creating image(s)
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'trusted_certs' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] No VIF found with MAC fa:16:3e:02:e7:bd, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "06188b59c973150c435ea289dbe823ebab0e2ae3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "06188b59c973150c435ea289dbe823ebab0e2ae3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-7da62cc8-9336-432e-a126-d6c1239d33b0 req-3832d177-b9ec-4a8e-85e8-50505736b99e service nova] [instance: 767bfa5f-b93d-464a-847f-1838a6e5ed66] Received event network-vif-deleted-be8536da-1fa4-4240-9088-7d1935223982 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e048f9d9-0e87-4a19-bd6c-aefdcd36b4f0 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.050s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.513s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.virt.images [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] affaedb7-00ce-4827-87b2-df9bd1737040 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.part /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:22 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance 767bfa5f-b93d-464a-847f-1838a6e5ed66
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:22 user nova-compute[74507]: WARNING nova.compute.manager [req-a4bb1434-461d-426b-bef6-5776d3e6a144 req-bd46d602-b384-409c-95af-eb3b7def01a8 service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state active and task_state rescuing.
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11f16ca5-9da8-427b-bb7d-1921464707b7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "767bfa5f-b93d-464a-847f-1838a6e5ed66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.625s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.part /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.converted" returned: 0 in 0.336s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "06188b59c973150c435ea289dbe823ebab0e2ae3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.859s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "06188b59c973150c435ea289dbe823ebab0e2ae3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "06188b59c973150c435ea289dbe823ebab0e2ae3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3 --force-share --output=json" returned: 0 in 0.214s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3,backing_fmt=raw /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3,backing_fmt=raw /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue" returned: 0 in 0.047s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "06188b59c973150c435ea289dbe823ebab0e2ae3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'migration_context' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<bfaca483-bad0-4b7e-a6cf-74998913ba30> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start _get_guest_xml network_info=[{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:65:73:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'affaedb7-00ce-4827-87b2-df9bd1737040', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bf97553b-c61b-47bc-9c46-0f6af5a6f013', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bfaca483-bad0-4b7e-a6cf-74998913ba30', 'attached_at': '', 'detached_at': '', 'volume_id': '4677aa72-1371-449a-814d-a2e9acd25604', 'serial': '4677aa72-1371-449a-814d-a2e9acd25604'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<bfaca483-bad0-4b7e-a6cf-74998913ba30> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'numa_topology' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<bfaca483-bad0-4b7e-a6cf-74998913ba30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:23 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'vcpu_model' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<bfaca483-bad0-4b7e-a6cf-74998913ba30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:07:23 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:23 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:07:23 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e367be-258d-4b60-bad0-e509f096492e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ozKFfWLq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 23:07:23 user nova-compute[74507]: node.name = iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:07:23 user nova-compute[74507]: node.tpgt = -1
Oct 25 23:07:23 user nova-compute[74507]: node.startup = automatic
Oct 25 23:07:23 user nova-compute[74507]: node.leading_login = No
Oct 25 23:07:23 user nova-compute[74507]: iface.iscsi_ifacename = default
Oct 25 23:07:23 user nova-compute[74507]: iface.net_ifacename = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.ipaddress = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.prefix_len = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.hwaddress = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.transport_name = tcp
Oct 25 23:07:23 user nova-compute[74507]: iface.initiatorname = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.vlan_id = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.vlan_priority = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.vlan_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.iface_num = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.mtu = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.port = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.bootproto = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.subnet_mask = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.gateway = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_alt_client_id = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_dns = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_learn_iqn = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_vendor_id_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_vendor_id = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.dhcp_slp_da = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.fragmentation = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.gratuitous_arp = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.incoming_forwarding = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.tos_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.tos = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.ttl = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.delayed_ack = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.tcp_nagle = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.tcp_wsf_state = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.tcp_wsf = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.tcp_timer_scale = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.tcp_timestamp = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.redirect = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.def_task_mgmt_timeout = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.header_digest = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.data_digest = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.immediate_data = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.initial_r2t = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.data_seq_inorder = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.data_pdu_inorder = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.erl = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.max_receive_data_len = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.first_burst_len = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.max_outstanding_r2t = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.max_burst_len = 0
Oct 25 23:07:23 user nova-compute[74507]: iface.chap_auth = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.bidi_chap = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.strict_login_compliance = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.discovery_auth = <empty>
Oct 25 23:07:23 user nova-compute[74507]: iface.discovery_logout = <empty>
Oct 25 23:07:23 user nova-compute[74507]: node.discovery_address = <empty>
Oct 25 23:07:23 user nova-compute[74507]: node.discovery_port = 0
Oct 25 23:07:23 user nova-compute[74507]: node.discovery_type = static
Oct 25 23:07:23 user nova-compute[74507]: node.session.initial_cmdsn = 0
Oct 25 23:07:23 user nova-compute[74507]: node.session.initial_login_retry_max = 8
Oct 25 23:07:23 user nova-compute[74507]: node.session.xmit_thread_priority = -20
Oct 25 23:07:23 user nova-compute[74507]: node.session.cmds_max = 128
Oct 25 23:07:23 user nova-compute[74507]: node.session.queue_depth = 32
Oct 25 23:07:23 user nova-compute[74507]: node.session.nr_sessions = 1
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.authmethod = CHAP
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.username = ozKFfWLq
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.password = ***
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.username_in = <empty>
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.password_in = <empty>
Oct 25 23:07:23 user nova-compute[74507]: node.session.auth.chap_algs = MD5
Oct 25 23:07:23 user nova-compute[74507]: node.session.timeo.replacement_timeout = 120
Oct 25 23:07:23 user nova-compute[74507]: node.session.err_timeo.abort_timeout = 15
Oct 25 23:07:23 user nova-compute[74507]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 23:07:23 user nova-compute[74507]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 23:07:23 user nova-compute[74507]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.FastAbort = Yes
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.InitialR2T = No
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.ImmediateData = Yes
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.MaxConnections = 1
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 23:07:23 user nova-compute[74507]: node.session.iscsi.ERL = 0
Oct 25 23:07:23 user nova-compute[74507]: node.session.scan = manual
Oct 25 23:07:23 user nova-compute[74507]: node.session.reopen_max = 0
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].address = 172.16.0.220
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].port = 3260
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].startup = manual
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].tcp.window_size = 524288
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].tcp.type_of_service = 0
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].timeo.logout_timeout = 15
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].timeo.login_timeout = 15
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].timeo.auth_timeout = 45
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.DataDigest = None
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.IFMarker = No
Oct 25 23:07:23 user nova-compute[74507]: node.conn[0].iscsi.OFMarker = No
Oct 25 23:07:23 user nova-compute[74507]: # END RECORD
Oct 25 23:07:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d3cc3-5db6-4be2-8b8c-a0b4a1c57c0c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbe945-c33f-4cae-b3b3-d697a55d4fd4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozKFfWLq {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozKFfWLq" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d68b0-a031-49ed-b091-b970bf476c96]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozKFfWLq'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3508883f-51e1-495e-abd8-cfb1c787ac05]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[af37bb89-0219-4e78-a804-d0611801ca47]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:07:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:07:23 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:07:23 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.203s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] HCTL ('36', '0', '0', 0) found on session 40 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79eff0c-dad6-4f46-99bc-504fccefb783]: (4, ('0 0 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Searching for a device in session 40 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '23263626432303231', 'path': '/dev/sde'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263626432303231', 'path': '/dev/sde'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1995183307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1995183307',id=36,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-0p3bx0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:06:11Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=bfaca483-bad0-4b7e-a6cf-74998913ba30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:65:73:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "vif_mac": "fa:16:3e:65:73:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'pci_devices' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.objects.base [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Object Instance<bfaca483-bad0-4b7e-a6cf-74998913ba30> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:07:23 user nova-compute[74507]:   <uuid>bfaca483-bad0-4b7e-a6cf-74998913ba30</uuid>
Oct 25 23:07:23 user nova-compute[74507]:   <name>instance-00000024</name>
Oct 25 23:07:23 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:07:23 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:07:23 user nova-compute[74507]:   <metadata>
Oct 25 23:07:23 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:07:23 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1995183307</nova:name>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:07:23</nova:creationTime>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:07:23 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:07:23 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:owner>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:user uuid="4da245cae18d400ab7b8c787bfd10156">tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member</nova:user>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:project uuid="8cdf2550d504422686b0a2a829758690">tempest-ServerBootFromVolumeStableRescueTest-1413973068</nova:project>
Oct 25 23:07:23 user nova-compute[74507]:       </nova:owner>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:07:23 user nova-compute[74507]:       <nova:ports>
Oct 25 23:07:23 user nova-compute[74507]:         <nova:port uuid="adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d">
Oct 25 23:07:23 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 23:07:23 user nova-compute[74507]:         </nova:port>
Oct 25 23:07:23 user nova-compute[74507]:       </nova:ports>
Oct 25 23:07:23 user nova-compute[74507]:     </nova:instance>
Oct 25 23:07:23 user nova-compute[74507]:   </metadata>
Oct 25 23:07:23 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:07:23 user nova-compute[74507]:     <system>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="serial">bfaca483-bad0-4b7e-a6cf-74998913ba30</entry>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="uuid">bfaca483-bad0-4b7e-a6cf-74998913ba30</entry>
Oct 25 23:07:23 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:07:23 user nova-compute[74507]:     </system>
Oct 25 23:07:23 user nova-compute[74507]:   </sysinfo>
Oct 25 23:07:23 user nova-compute[74507]:   <os>
Oct 25 23:07:23 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:07:23 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:07:23 user nova-compute[74507]:   </os>
Oct 25 23:07:23 user nova-compute[74507]:   <features>
Oct 25 23:07:23 user nova-compute[74507]:     <acpi/>
Oct 25 23:07:23 user nova-compute[74507]:     <apic/>
Oct 25 23:07:23 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:07:23 user nova-compute[74507]:   </features>
Oct 25 23:07:23 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:07:23 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:07:23 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:07:23 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:07:23 user nova-compute[74507]:   </clock>
Oct 25 23:07:23 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:07:23 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:07:23 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:07:23 user nova-compute[74507]:   </cpu>
Oct 25 23:07:23 user nova-compute[74507]:   <devices>
Oct 25 23:07:23 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:07:23 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:07:23 user nova-compute[74507]:       <source dev="/dev/sde"/>
Oct 25 23:07:23 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:07:23 user nova-compute[74507]:       <serial>4677aa72-1371-449a-814d-a2e9acd25604</serial>
Oct 25 23:07:23 user nova-compute[74507]:     </disk>
Oct 25 23:07:23 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:07:23 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:07:23 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue"/>
Oct 25 23:07:23 user nova-compute[74507]:       <target dev="vdb" bus="virtio"/>
Oct 25 23:07:23 user nova-compute[74507]:       <boot order="1"/>
Oct 25 23:07:23 user nova-compute[74507]:     </disk>
Oct 25 23:07:23 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:07:23 user nova-compute[74507]:       <mac address="fa:16:3e:65:73:a9"/>
Oct 25 23:07:23 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:07:23 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:07:23 user nova-compute[74507]:       <target dev="tapadc810bd-8a"/>
Oct 25 23:07:23 user nova-compute[74507]:     </interface>
Oct 25 23:07:23 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:07:23 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/console.log" append="off"/>
Oct 25 23:07:23 user nova-compute[74507]:     </serial>
Oct 25 23:07:23 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:07:23 user nova-compute[74507]:     <video>
Oct 25 23:07:23 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:07:23 user nova-compute[74507]:     </video>
Oct 25 23:07:23 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:07:23 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:07:23 user nova-compute[74507]:     </rng>
Oct 25 23:07:23 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:07:23 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:07:23 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:07:23 user nova-compute[74507]:     </memballoon>
Oct 25 23:07:23 user nova-compute[74507]:   </devices>
Oct 25 23:07:23 user nova-compute[74507]: </domain>
Oct 25 23:07:23 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:07:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance destroyed successfully.
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:07:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] No VIF found with MAC fa:16:3e:65:73:a9, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-changed-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing instance network info cache due to event network-changed-def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG nova.network.neutron [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing network info cache for port def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated VIF entry in instance network info cache for port def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:07:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-70c8e766-7dc3-4c0f-9bf5-2870abd0c520 req-5461f12c-f0b9-4d03-b980-b2ba6509a1c2 service nova] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:26 user nova-compute[74507]: WARNING nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state active and task_state rescuing.
Oct 25 23:07:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:26 user nova-compute[74507]: WARNING nova.compute.manager [req-b278fb1c-5957-4609-80f7-098ea7e3f218 req-b8d2d932-a5ae-4dc0-943e-06dd08057d6c service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state active and task_state rescuing.
Oct 25 23:07:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a021d79d-fdf6-4777-8a65-9b921d3de522 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-changed-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing instance network info cache due to event network-changed-def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing network info cache for port def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated VIF entry in instance network info cache for port def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f8584197-97aa-4c1d-b7a0-3142684df2c8 req-f66cc63d-3db5-4984-abda-e859b7013789 service nova] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:28 user nova-compute[74507]: INFO nova.compute.manager [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Rebooting instance
Oct 25 23:07:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:28 user nova-compute[74507]: DEBUG nova.network.neutron [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:07:29 user nova-compute[74507]: DEBUG nova.network.neutron [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:07:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:32 user nova-compute[74507]: WARNING nova.compute.manager [req-19eb05cc-9a0c-4cd6-9ca7-567cfdd3c84a req-3c16bf26-5586-41c4-aaa5-a3893b28e7dc service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state active and task_state reboot_started.
Oct 25 23:07:32 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance shutdown successfully.
Oct 25 23:07:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:34 user nova-compute[74507]: WARNING nova.compute.manager [req-fd42bd78-7cc6-4ee6-8ccd-a1394756ee5c req-222317d1-ea3a-4d79-8f8f-d21df5b0b076 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state active and task_state reboot_started.
Oct 25 23:07:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:36 user nova-compute[74507]: WARNING nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state active and task_state reboot_started.
Oct 25 23:07:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:07:36 user nova-compute[74507]: WARNING nova.compute.manager [req-52865be4-7b3e-4171-a41d-7b3e0afce71f req-a35f5b53-eaf7-4059-adcd-1e7e8f8f1338 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state active and task_state reboot_started.
Oct 25 23:07:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance running successfully.
Oct 25 23:07:36 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance soft rebooted successfully.
Oct 25 23:07:36 user nova-compute[74507]: DEBUG nova.compute.manager [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-778602ec-e192-41b2-8eeb-b831f34dbd6b tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.880s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:41 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:42 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:07:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updating instance_info_cache with network_info: [{"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-8bbaa172-1185-436c-a935-f1b8bc337801" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:48 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:07:50 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:50 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7707MB free_disk=24.74853515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b79e0322-0c82-47ec-84b8-9943678f00d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d3fd54be-06e8-4020-a67b-350a1c8f32c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 66439d36-425e-43cd-a932-2ab553f840c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:07:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:07:51 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:07:51 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:07:51 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:07:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:07:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:58 user nova-compute[74507]: INFO nova.compute.manager [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Unshelving
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_requests' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'numa_topology' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:07:58 user nova-compute[74507]: INFO nova.compute.claims [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Claim successful on node user
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:07:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:58 user nova-compute[74507]: INFO nova.network.neutron [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing instance network info cache due to event network-changed-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:07:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Creating image(s)
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Refreshing network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG nova.objects.base [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<d7560741-7dcd-45bc-b9cb-aed2ffc5cf51> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "f635c95620720dade80261b7b30f773f64ea2498" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:07:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f635c95620720dade80261b7b30f773f64ea2498" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.part --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG nova.virt.images [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] 9f74380f-e8d3-431f-874b-f9047fd42c01 was qcow2, converting to raw {{(pid=74507) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG nova.privsep.utils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74507) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.part /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.converted {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updated VIF entry in instance network info cache for port f5d436ee-d7f9-42a7-ae52-646b1a57c6c7. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d710227c-8609-4cd5-b40e-6dac0a2cceea req-a4c3fb4b-ef7a-401b-8670-07077b9ff07e service nova] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.part /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.converted" returned: 0 in 0.371s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.converted --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f635c95620720dade80261b7b30f773f64ea2498" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.759s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "f635c95620720dade80261b7b30f773f64ea2498" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f635c95620720dade80261b7b30f773f64ea2498" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498,backing_fmt=raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498,backing_fmt=raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk 1073741824" returned: 0 in 0.048s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "f635c95620720dade80261b7b30f773f64ea2498" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'migration_context' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG nova.objects.base [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<d7560741-7dcd-45bc-b9cb-aed2ffc5cf51> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:08:02 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Rebasing disk image.
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab -F raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab -F raw /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk" returned: 0 in 2.606s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Ensure instance console log exists: /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start _get_guest_xml network_info=[{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='70121ca9613727aa300b765d30a22e0a',container_format='bare',created_at=2023-10-25T23:06:05Z,direct_url=<?>,disk_format='qcow2',id=9f74380f-e8d3-431f-874b-f9047fd42c01,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1923410532-shelved',owner='efbf59e935fe4170b38670efe09764dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T23:06:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:08:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:08:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='70121ca9613727aa300b765d30a22e0a',container_format='bare',created_at=2023-10-25T23:06:05Z,direct_url=<?>,disk_format='qcow2',id=9f74380f-e8d3-431f-874b-f9047fd42c01,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1923410532-shelved',owner='efbf59e935fe4170b38670efe09764dc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T23:06:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.objects.base [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<d7560741-7dcd-45bc-b9cb-aed2ffc5cf51> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='9f74380f-e8d3-431f-874b-f9047fd42c01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2023587710',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T23:06:10.234460',shelved_host='user',shelved_image_id='9f74380f-e8d3-431f-874b-f9047fd42c01'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'pci_devices' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.objects.base [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Object Instance<d7560741-7dcd-45bc-b9cb-aed2ffc5cf51> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74507) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:08:05 user nova-compute[74507]:   <uuid>d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</uuid>
Oct 25 23:08:05 user nova-compute[74507]:   <name>instance-00000021</name>
Oct 25 23:08:05 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:08:05 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:08:05 user nova-compute[74507]:   <metadata>
Oct 25 23:08:05 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:08:05 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1923410532</nova:name>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:08:05</nova:creationTime>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:08:05 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:08:05 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:owner>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:user uuid="b81defc8e43843d3b14cc249f9e7dd73">tempest-AttachVolumeShelveTestJSON-2059391716-project-member</nova:user>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:project uuid="efbf59e935fe4170b38670efe09764dc">tempest-AttachVolumeShelveTestJSON-2059391716</nova:project>
Oct 25 23:08:05 user nova-compute[74507]:       </nova:owner>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:root type="image" uuid="9f74380f-e8d3-431f-874b-f9047fd42c01"/>
Oct 25 23:08:05 user nova-compute[74507]:       <nova:ports>
Oct 25 23:08:05 user nova-compute[74507]:         <nova:port uuid="f5d436ee-d7f9-42a7-ae52-646b1a57c6c7">
Oct 25 23:08:05 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 23:08:05 user nova-compute[74507]:         </nova:port>
Oct 25 23:08:05 user nova-compute[74507]:       </nova:ports>
Oct 25 23:08:05 user nova-compute[74507]:     </nova:instance>
Oct 25 23:08:05 user nova-compute[74507]:   </metadata>
Oct 25 23:08:05 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:08:05 user nova-compute[74507]:     <system>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="serial">d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</entry>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="uuid">d7560741-7dcd-45bc-b9cb-aed2ffc5cf51</entry>
Oct 25 23:08:05 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:08:05 user nova-compute[74507]:     </system>
Oct 25 23:08:05 user nova-compute[74507]:   </sysinfo>
Oct 25 23:08:05 user nova-compute[74507]:   <os>
Oct 25 23:08:05 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:08:05 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:08:05 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:08:05 user nova-compute[74507]:   </os>
Oct 25 23:08:05 user nova-compute[74507]:   <features>
Oct 25 23:08:05 user nova-compute[74507]:     <acpi/>
Oct 25 23:08:05 user nova-compute[74507]:     <apic/>
Oct 25 23:08:05 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:08:05 user nova-compute[74507]:   </features>
Oct 25 23:08:05 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:08:05 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:08:05 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:08:05 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:08:05 user nova-compute[74507]:   </clock>
Oct 25 23:08:05 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:08:05 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:08:05 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:08:05 user nova-compute[74507]:   </cpu>
Oct 25 23:08:05 user nova-compute[74507]:   <devices>
Oct 25 23:08:05 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:08:05 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:08:05 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk"/>
Oct 25 23:08:05 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:08:05 user nova-compute[74507]:     </disk>
Oct 25 23:08:05 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:08:05 user nova-compute[74507]:       <mac address="fa:16:3e:be:4b:e3"/>
Oct 25 23:08:05 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:08:05 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:08:05 user nova-compute[74507]:       <target dev="tapf5d436ee-d7"/>
Oct 25 23:08:05 user nova-compute[74507]:     </interface>
Oct 25 23:08:05 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:08:05 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/console.log" append="off"/>
Oct 25 23:08:05 user nova-compute[74507]:     </serial>
Oct 25 23:08:05 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:08:05 user nova-compute[74507]:     <video>
Oct 25 23:08:05 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:08:05 user nova-compute[74507]:     </video>
Oct 25 23:08:05 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:08:05 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:08:05 user nova-compute[74507]:     </rng>
Oct 25 23:08:05 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:08:05 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:08:05 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:08:05 user nova-compute[74507]:     </memballoon>
Oct 25 23:08:05 user nova-compute[74507]:   </devices>
Oct 25 23:08:05 user nova-compute[74507]: </domain>
Oct 25 23:08:05 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='9f74380f-e8d3-431f-874b-f9047fd42c01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2023587710',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member',shelved_at='2023-10-25T23:06:10.234460',shelved_host='user',shelved_image_id='9f74380f-e8d3-431f-874b-f9047fd42c01'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG os_vif [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fadb9f01-45bf-5ab0-85ad-e7ad44554684', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5d436ee-d7, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5d436ee-d7, col_values=(('qos', UUID('dafe641e-2293-423f-bd12-9b8a85dbb464')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5d436ee-d7, col_values=(('external_ids', {'iface-id': 'f5d436ee-d7f9-42a7-ae52-646b1a57c6c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:4b:e3', 'vm-uuid': 'd7560741-7dcd-45bc-b9cb-aed2ffc5cf51'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:05 user nova-compute[74507]: INFO os_vif [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7')
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:08:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] No VIF found with MAC fa:16:3e:be:4b:e3, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:06 user nova-compute[74507]: WARNING nova.compute.manager [req-b1af0a11-5732-4ff3-9817-0f000f53d52f req-ab6c23cd-1107-4c14-8083-af3acfb4aa35 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:08:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:08 user nova-compute[74507]: WARNING nova.compute.manager [req-e50c78c7-e659-4b12-b81a-15a5f24d6786 req-a7bf56f5-ccdf-46e9-96c1-0001b36ca971 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 23:08:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:08:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:08:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance spawned successfully.
Oct 25 23:08:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:08:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-fb10e9cf-8f0a-4a16-9a52-e0fce0de4053 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.104s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:10 user nova-compute[74507]: INFO nova.compute.manager [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Terminating instance
Oct 25 23:08:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing instance network info cache due to event network-changed-4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] Acquiring lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] Acquired lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:08:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Refreshing network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0af54a8-461d-4339-9e90-9a5f1245ab02 req-610d0cad-fc3c-4da0-91ee-3460b698455a service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-unplugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:08:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Instance destroyed successfully.
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lazy-loading 'resources' on Instance uuid d3fd54be-06e8-4020-a67b-350a1c8f32c6 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1508559622',display_name='tempest-TestShelveInstance-server-1508559622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1508559622',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY4dqTZZtuKpbWuvSXuAGTGLKOG2AhqLGYVJbt3Wl/sbw9b8UrezvSYI5pDXPkJ408lc1u34VyvgKMURb0Ay/YPV7naGKRcgQJdLzcDGLabhGLdOAvtQ5TliD4/FK22Sg==',key_name='tempest-TestShelveInstance-585482898',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b79f154615e40ce8c4ef955fb3be5ef',ramdisk_id='',reservation_id='r-uf8shim4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-65908321',owner_user_name='tempest-TestShelveInstance-65908321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:06:48Z,user_data=None,user_id='bec0411e0f0e4e8f904477e0639d5491',uuid=d3fd54be-06e8-4020-a67b-350a1c8f32c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converting VIF {"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_vif [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c0e9752-77, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7622177-150d-4379-a34d-43552a44c772) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: INFO os_vif [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:96,bridge_name='br-int',has_traffic_filtering=True,id=4c0e9752-7776-4583-a467-68ac9bcf9c10,network=Network(2ced6f44-036e-46e5-a1e3-12cbed25931d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0e9752-77')
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwZCGRvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:11 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b5a13-5b3c-44cd-8dbc-683710f93156]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:08:11 user nova-compute[74507]: No targets found.
Oct 25 23:08:11 user nova-compute[74507]: iSNS:
Oct 25 23:08:11 user nova-compute[74507]: No targets found.
Oct 25 23:08:11 user nova-compute[74507]: STATIC:
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:08:11 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:11 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:11 user nova-compute[74507]: FIRMWARE:
Oct 25 23:08:11 user nova-compute[74507]: No targets found.
Oct 25 23:08:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:08:11 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:08:11 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7ccbf5-ef13-4a68-ac76-246c213c1e3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7241aab8-cec9-4c09-b35f-c7b6ed2c505b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:11 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5465bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886'): ({'sdf'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Removing single pathed devices sdf {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed302dbd-e8d4-4744-96ee-18dda014692c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f814965-88d5-43b3-9193-9f939f323bc4]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Flushing IO for device /dev/sdf {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71840ae-65a3-4113-845e-4e5459e800ab]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d9a0c9-a618-48b2-b062-0bdeed35b511]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] SCSI volumes sdf have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[295fa661-419d-4c3d-8bfd-862bb1c32dcc]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae150ee7-8994-4417-bd5a-6236b617eaec]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260]
Oct 25 23:08:11 user nova-compute[74507]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886, portal: 172.16.0.220,3260] successful.
Oct 25 23:08:11 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8e70df5-f915-45eb-bc53-d16c64500886 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c19d5-9e91-42f9-8765-4f472f893771]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] <== disconnect_volume: return (379ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:08:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deleting instance files /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6_del
Oct 25 23:08:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deletion of /opt/stack/data/nova/instances/d3fd54be-06e8-4020-a67b-350a1c8f32c6_del complete
Oct 25 23:08:11 user nova-compute[74507]: INFO nova.compute.manager [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updated VIF entry in instance network info cache for port 4c0e9752-7776-4583-a467-68ac9bcf9c10. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [{"id": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "address": "fa:16:3e:b2:ea:96", "network": {"id": "2ced6f44-036e-46e5-a1e3-12cbed25931d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1948999425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b79f154615e40ce8c4ef955fb3be5ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0e9752-77", "ovs_interfaceid": "4c0e9752-7776-4583-a467-68ac9bcf9c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5685c17b-654e-4487-87cd-8ea558e14c7d req-756cab2e-897b-4215-9aa2-aaf4aa017d1f service nova] Releasing lock "refresh_cache-d3fd54be-06e8-4020-a67b-350a1c8f32c6" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:08:12 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:12 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Took 0.67 seconds to deallocate network for instance.
Oct 25 23:08:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-8ec905cb-6230-49cb-855d-b6635f8877b0 req-0d640780-cde0-489a-b1af-f825b9d6113a service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-deleted-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] Acquiring lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG nova.compute.manager [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] No waiting events found dispatching network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:13 user nova-compute[74507]: WARNING nova.compute.manager [req-941f1b86-4412-45b6-ae2d-b11d4cff3c75 req-736080ec-7e89-42cc-bb29-e7f40eb0bdc5 service nova] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Received unexpected event network-vif-plugged-4c0e9752-7776-4583-a467-68ac9bcf9c10 for instance with vm_state active and task_state deleting.
Oct 25 23:08:13 user nova-compute[74507]: INFO nova.compute.manager [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Took 1.03 seconds to detach 1 volumes for instance.
Oct 25 23:08:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] [instance: d3fd54be-06e8-4020-a67b-350a1c8f32c6] Deleting volume: f8e70df5-f915-45eb-bc53-d16c64500886 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:14 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:08:14 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:08:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:14 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Deleted allocations for instance d3fd54be-06e8-4020-a67b-350a1c8f32c6
Oct 25 23:08:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-75fec47d-5012-478d-b808-e4299426bbba tempest-TestShelveInstance-65908321 tempest-TestShelveInstance-65908321-project-member] Lock "d3fd54be-06e8-4020-a67b-350a1c8f32c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.808s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:17 user nova-compute[74507]: INFO nova.compute.manager [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Terminating instance
Oct 25 23:08:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-unplugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] No waiting events found dispatching network-vif-unplugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b73d062b-4533-434f-80b6-ef3cc0d7faaa req-8364dcb8-0f95-4d17-a0b8-bea9acbfd2bb service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-unplugged-3a01894c-7488-4f97-b320-f414fae48176 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:08:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Instance destroyed successfully.
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid b79e0322-0c82-47ec-84b8-9943678f00d9 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:03:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2118522201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2118522201',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMJjOH4uQeu9x4bGnikepXnITQ9JboYE4tYqso71fKDtxM76yM2h1KPqJ0yzSA0oVU4i9E1Jn2ha7/XJ9I+hwKy9siG9Nh1JZndven9pp5zjAHP2NLcWTcFc1I7MGWP2A==',key_name='tempest-keypair-34917203',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0abrj8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b79e0322-0c82-47ec-84b8-9943678f00d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "3a01894c-7488-4f97-b320-f414fae48176", "address": "fa:16:3e:ff:90:44", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a01894c-74", "ovs_interfaceid": "3a01894c-7488-4f97-b320-f414fae48176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_vif [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a01894c-74, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9337608b-c9c6-4d61-ba85-3e4969941acb) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:18 user nova-compute[74507]: INFO os_vif [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:90:44,bridge_name='br-int',has_traffic_filtering=True,id=3a01894c-7488-4f97-b320-f414fae48176,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a01894c-74')
Oct 25 23:08:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhDdOWoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee2d1d-bd75-45ba-9b14-1bbe658ec2a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:08:18 user nova-compute[74507]: No targets found.
Oct 25 23:08:18 user nova-compute[74507]: iSNS:
Oct 25 23:08:18 user nova-compute[74507]: No targets found.
Oct 25 23:08:18 user nova-compute[74507]: STATIC:
Oct 25 23:08:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314
Oct 25 23:08:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:08:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:08:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:08:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:08:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:18 user nova-compute[74507]: FIRMWARE:
Oct 25 23:08:18 user nova-compute[74507]: No targets found.
Oct 25 23:08:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:08:18 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:08:18 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:08:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8567271-7950-4994-8aa0-45539914fca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983e0d9-e6a7-4068-8ee8-19af445f529d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:19 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546de320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe952b9-4efc-4882-83af-4f43e9938ca5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95196d24-c11e-4795-89d9-9905d3ff6d26]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95abcfdb-0083-468e-aefd-fdc2982051eb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524c58a-1024-4686-974f-6553f8b55e2e]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e2b7c-1bc1-4d0a-b2d2-67a36c6726da]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c55a8a-9266-4000-ba45-6d074684f017]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260]
Oct 25 23:08:19 user nova-compute[74507]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314, portal: 172.16.0.220,3260] successful.
Oct 25 23:08:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fba4bf-770c-469c-818a-f02d9b0a1314 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae452b-cfc0-418a-8580-b6e21faa94f8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (385ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:08:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Deleting instance files /opt/stack/data/nova/instances/b79e0322-0c82-47ec-84b8-9943678f00d9_del
Oct 25 23:08:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Deletion of /opt/stack/data/nova/instances/b79e0322-0c82-47ec-84b8-9943678f00d9_del complete
Oct 25 23:08:19 user nova-compute[74507]: INFO nova.compute.manager [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 25 23:08:19 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:08:19 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] Acquiring lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] No waiting events found dispatching network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:20 user nova-compute[74507]: WARNING nova.compute.manager [req-528f02d1-7268-4afc-b67c-015d4d46ae4c req-1e237670-45d3-4182-a4cc-58cd3381b4bd service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received unexpected event network-vif-plugged-3a01894c-7488-4f97-b320-f414fae48176 for instance with vm_state active and task_state deleting.
Oct 25 23:08:20 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Took 1.10 seconds to deallocate network for instance.
Oct 25 23:08:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-a7634aee-d640-4367-8e7b-d50310961120 req-81681a23-549b-4ca9-a12f-6bc9369ee325 service nova] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Received event network-vif-deleted-3a01894c-7488-4f97-b320-f414fae48176 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:21 user nova-compute[74507]: INFO nova.compute.manager [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Took 0.90 seconds to detach 1 volumes for instance.
Oct 25 23:08:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b79e0322-0c82-47ec-84b8-9943678f00d9] Deleting volume: 79fba4bf-770c-469c-818a-f02d9b0a1314 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:08:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:21 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:08:21 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:08:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:21 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance b79e0322-0c82-47ec-84b8-9943678f00d9
Oct 25 23:08:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e028f1d4-5571-4b54-8168-1e6d4d5e81c7 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b79e0322-0c82-47ec-84b8-9943678f00d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.064s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-changed-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Refreshing instance network info cache due to event network-changed-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] Acquiring lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] Acquired lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Refreshing network info cache for port ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updated VIF entry in instance network info cache for port ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG nova.network.neutron [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating instance_info_cache with network_info: [{"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-722d12c6-71db-4226-bf9d-2491c7ba35d2 req-caab3315-0bf4-4e7f-891f-088e082a621e service nova] Releasing lock "refresh_cache-1d685c29-b491-47bd-aebd-ecd45d3bef5b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:08:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:34 user nova-compute[74507]: INFO nova.compute.manager [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Attaching volume 8acdbea1-83ce-4efb-a643-9916519d4de0 to /dev/vdb
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.utils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a106f5b1-41e0-4904-8a49-612509670c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b05b6a-47f6-4321-902f-0a647fd04320]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e1acd-227a-46ac-bd69-da50992b36c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4294b63-0d54-470c-b4a5-bc3c70f11be0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:08:34 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:08:34 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb29266-a812-4a35-93f8-41340f8cdbab]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG os_brick.utils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:34 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating existing volume attachment record: 30bdb997-2f48-4da2-bf64-d03484170115 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:08:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-changed-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Refreshing instance network info cache due to event network-changed-b24478f9-98a5-4c98-af2f-a65350649a17. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:08:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] Acquiring lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:08:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] Acquired lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:08:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Refreshing network info cache for port b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:08:36 user nova-compute[74507]: INFO nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Rebuilding instance
Oct 25 23:08:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updated VIF entry in instance network info cache for port b24478f9-98a5-4c98-af2f-a65350649a17. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.network.neutron [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating instance_info_cache with network_info: [{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-025ef68d-79ce-411b-985d-fa64390fe160 req-01b0fbfe-1b8b-4863-82e7-14a81c301fd9 service nova] Releasing lock "refresh_cache-66439d36-425e-43cd-a932-2ab553f840c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:37 user nova-compute[74507]: WARNING nova.compute.manager [req-5f834d7b-d137-4153-82e7-8bb729ee5ee4 req-2da5d87a-8fe2-41e6-acc0-51356f1a561a service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state active and task_state rebuilding.
Oct 25 23:08:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance destroyed successfully.
Oct 25 23:08:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance destroyed successfully.
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1364832038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG os_vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24478f9-98, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03685498-1926-4639-914d-933f0fdd4546) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:08:37 user nova-compute[74507]: INFO os_vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98')
Oct 25 23:08:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:37 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 23:08:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:37 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb973cd5-7b6e-4840-a57d-87fca96823c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]: iSNS:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]: STATIC:
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: FIRMWARE:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:08:38 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:08:38 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f289596-d99c-403d-b0d6-fe43d03b15b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438ff1c-1400-4337-ab1f-dfe80099800f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546dce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2'): ({'sdg'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Removing single pathed devices sdg {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9dd87b-effc-4f9d-b28f-93b6e53e5779]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef67155-2962-4e51-9cb7-82b3e023bea8]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flushing IO for device /dev/sdg {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6c115-61cd-4b41-951c-882d27a0e24f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4209e-c052-4093-929a-f1a1edde7613]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] SCSI volumes sdg have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO53bb06d9-73d79e9a68705c38', '/dev/disk/by-id/scsi-23733643739653961', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53bb06d9') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424ce98-fc3f-4e99-a349-f6ab0d68be6c]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10823051-5942-483d-bb99-a772116d98df]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97346df8-5bf9-4ad7-9a05-1bb2e7d073e2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]
Oct 25 23:08:38 user nova-compute[74507]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d826da0-e438-4f78-b78d-cbd5b762d89a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== disconnect_volume: return (331ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:08:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deleting instance files /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5_del
Oct 25 23:08:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deletion of /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5_del complete
Oct 25 23:08:38 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 66439d36-425e-43cd-a932-2ab553f840c5 could not be found.
Oct 25 23:08:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:38 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e63d6b-56cd-4e35-be71-e33de73a59e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]: iSNS:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]: STATIC:
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:08:38 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:08:38 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:08:38 user nova-compute[74507]: FIRMWARE:
Oct 25 23:08:38 user nova-compute[74507]: No targets found.
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:08:38 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:08:38 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b07401-3b5a-43a6-b128-2295ecccf5cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ada790-ae2a-41a6-acc8-8e820a8d0199]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:38 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:38 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546dc430>, {}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Disconnecting from: [] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== disconnect_volume: return (71ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:08:39 user nova-compute[74507]: WARNING nova.compute.manager [req-9158f0f5-557c-49e2-bbb8-c8037bb2a50f req-bae4ac59-6359-4b69-a4c5-b989e47b4388 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state active and task_state rebuilding.
Oct 25 23:08:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Preparing to wait for external event volume-reimaged-f0fce950-c37f-4bcc-9649-7d58a4fcebe2 {{(pid=74507) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:42 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:43 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:08:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:08:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:08:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [{"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:08:49 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:08:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=7981MB free_disk=24.71127700805664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 66439d36-425e-43cd-a932-2ab553f840c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:08:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBmETCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:08:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:08:53 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b573afc-9eb2-486a-a363-07d2c40047f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:08:53 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18886a4d-fe41-4a18-b432-a6f6b75967f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0] added
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1abe60c-f581-40b5-ae71-fbe1204eff9f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ecd60b-9030-493a-ac83-fdcca6a81587]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OBmETCye {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OBmETCye" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37912aa0-9a9a-4dc4-a25d-802ef054cc49]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OBmETCye'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8812f16-c03a-4896-bb28-e26e42e2605c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc3a43b-2ae6-4d25-9995-b2d43dd23864]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27caebae-eea7-406e-8169-024001413b42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260]
Oct 25 23:08:53 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260] successful.
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e4da58-6cc0-4e1d-9722-b3fce89a8acf]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af721b4-2109-4a2c-a29f-e82dc4532e66]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:08:53 user nova-compute[74507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)
Oct 25 23:08:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480f6cb-c157-4714-b97e-159943295a5e]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:08:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBmETCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26166343030616562', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166343030616562', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:08:54 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:08:54 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:08:54 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:08:54 user nova-compute[74507]:   <serial>8acdbea1-83ce-4efb-a643-9916519d4de0</serial>
Oct 25 23:08:54 user nova-compute[74507]: </disk>
Oct 25 23:08:54 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:08:54 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:08:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:76:80:33, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:08:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1e51016e-1baa-4161-8bb6-4aa26064d4d2 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.841s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:08:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:08:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:08:56 user nova-compute[74507]: INFO nova.compute.manager [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Detaching volume 8acdbea1-83ce-4efb-a643-9916519d4de0
Oct 25 23:08:56 user nova-compute[74507]: INFO nova.virt.block_device [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Attempting to driver detach volume 8acdbea1-83ce-4efb-a643-9916519d4de0 from mountpoint /dev/vdb
Oct 25 23:08:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Attempting to detach device vdb from instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:08:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:08:56 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:08:56 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:08:56 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:08:56 user nova-compute[74507]:   <serial>8acdbea1-83ce-4efb-a643-9916519d4de0</serial>
Oct 25 23:08:56 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:08:56 user nova-compute[74507]: </disk>
Oct 25 23:08:56 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:08:56 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b from the persistent domain config.
Oct 25 23:08:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:08:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:08:56 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:08:56 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:08:56 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:08:56 user nova-compute[74507]:   <serial>8acdbea1-83ce-4efb-a643-9916519d4de0</serial>
Oct 25 23:08:56 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:08:56 user nova-compute[74507]: </disk>
Oct 25 23:08:56 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:08:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:08:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:09:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 req-ea9a1a1d-19d3-4326-b552-2cdd7d7f3d5c service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event volume-reimaged-f0fce950-c37f-4bcc-9649-7d58a4fcebe2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 req-ea9a1a1d-19d3-4326-b552-2cdd7d7f3d5c service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 req-ea9a1a1d-19d3-4326-b552-2cdd7d7f3d5c service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 req-ea9a1a1d-19d3-4326-b552-2cdd7d7f3d5c service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG nova.compute.manager [req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 req-ea9a1a1d-19d3-4326-b552-2cdd7d7f3d5c service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Processing event volume-reimaged-f0fce950-c37f-4bcc-9649-7d58a4fcebe2 {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance event wait completed in 27 seconds for volume-reimaged {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:09:06 user nova-compute[74507]: INFO nova.virt.block_device [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Booting with volume f0fce950-c37f-4bcc-9649-7d58a4fcebe2 at /dev/vda
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.utils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11d0b8-0252-4442-b687-1547a369f297]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1cf4e1-ff3e-48ae-ab59-91ee2ba2c795]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad2a5c1-dadd-4b2f-9bcb-fb7bbc6a1c90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259bcd4-253c-48ff-aac4-480e864f03e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:09:06 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:09:06 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94776bec-1f00-4147-8817-d7ae88532bf4]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG os_brick.utils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating existing volume attachment record: dcf293a9-cc1b-4890-96da-6b5f18b0dddd {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:09:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:10 user nova-compute[74507]: INFO nova.compute.manager [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Unrescuing
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquired lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating instance_info_cache with network_info: [{"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Releasing lock "refresh_cache-bfaca483-bad0-4b7e-a6cf-74998913ba30" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'flavor' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:10 user nova-compute[74507]: WARNING nova.compute.manager [req-799aa131-3cb1-4154-8a8e-ebfb96c30550 req-94850cea-600b-456e-9622-0424bb07df3d service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance destroyed successfully.
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:12 user nova-compute[74507]: WARNING nova.compute.manager [req-132196b4-3985-44d6-897d-2b3cbf3b5097 req-fccffc19-beee-434a-a3dd-0a48e31912cb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:09:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:15 user nova-compute[74507]: DEBUG nova.compute.manager [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:15 user nova-compute[74507]: WARNING nova.compute.manager [req-a8ca446e-3c45-42d8-b932-165fba8ee62c req-3fc0eafd-764f-409e-8a54-b9eeb453a70b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state rescued and task_state unrescuing.
Oct 25 23:09:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7bb93ef2-a05c-46fc-aa4f-17522ed58cea tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:09:16 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b is timed out.
Oct 25 23:09:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b from the live domain config.
Oct 25 23:09:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBmETCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:09:16 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa7c8b-32a2-44f1-b5e7-edd22fafc252]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:09:16 user nova-compute[74507]: No targets found.
Oct 25 23:09:16 user nova-compute[74507]: iSNS:
Oct 25 23:09:16 user nova-compute[74507]: No targets found.
Oct 25 23:09:16 user nova-compute[74507]: STATIC:
Oct 25 23:09:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0
Oct 25 23:09:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:09:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:09:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:16 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:09:16 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:16 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:16 user nova-compute[74507]: FIRMWARE:
Oct 25 23:09:16 user nova-compute[74507]: No targets found.
Oct 25 23:09:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:09:16 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:09:16 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b140bb58-ce8d-48c4-a435-d0d10342d544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea10fc5-0ad1-4208-b925-22e35b693ffb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)
Oct 25 23:09:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:16 user nova-compute[74507]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 (non-flash)
Oct 25 23:09:16 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b544d4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b743f4f-c12b-44ae-9211-efc3069f9348]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e881a4-6aeb-4667-b6d3-3f85e9a72aae]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[86763c7d-67c4-4d46-8e11-013980f3a15b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161de81-9dce-4e80-bbb1-8cfed1feff45]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a0ca0-f5fb-410c-829b-d9035e2dee07]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.186s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd8eb4-05f4-47c5-a593-e68470ef1551]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260]
Oct 25 23:09:17 user nova-compute[74507]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0, portal: 172.16.0.220,3260] successful.
Oct 25 23:09:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8acdbea1-83ce-4efb-a643-9916519d4de0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec91a2-bcf9-425b-9882-7d8daf3397d4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.811s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== disconnect_volume: return (813ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:09:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-749f404c-d7df-44b9-bbdf-b93981da8228 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.429s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-changed-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing instance network info cache due to event network-changed-def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:09:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:20 user nova-compute[74507]: DEBUG nova.network.neutron [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing network info cache for port def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated VIF entry in instance network info cache for port def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b562d6c2-33c6-4f8e-b7db-2c1a63875fa3 req-483a646f-65b2-4fb9-9f40-643a5ad7b7f6 service nova] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-changed-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing instance network info cache due to event network-changed-def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.network.neutron [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Refreshing network info cache for port def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:21 user nova-compute[74507]: INFO nova.compute.manager [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Detaching volume 35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:09:21 user nova-compute[74507]: INFO nova.virt.block_device [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Attempting to driver detach volume 35cb8abc-d9e3-4c5e-8129-cbb157a70c5e from mountpoint /dev/vdb
Oct 25 23:09:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Attempting to detach device vdb from instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:09:21 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:09:21 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:09:21 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:09:21 user nova-compute[74507]:   <serial>35cb8abc-d9e3-4c5e-8129-cbb157a70c5e</serial>
Oct 25 23:09:21 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:09:21 user nova-compute[74507]: </disk>
Oct 25 23:09:21 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:09:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully detached device vdb from instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 from the persistent domain config.
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:09:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:09:21 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:09:21 user nova-compute[74507]:   <source dev="/dev/sdd"/>
Oct 25 23:09:21 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:09:21 user nova-compute[74507]:   <serial>35cb8abc-d9e3-4c5e-8129-cbb157a70c5e</serial>
Oct 25 23:09:21 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:09:21 user nova-compute[74507]: </disk>
Oct 25 23:09:21 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:09:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated VIF entry in instance network info cache for port def5828a-3040-4afc-9400-01d473d69921. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:09:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-289f2d2a-dc82-45b0-9697-e981bae3534d req-508392a2-689c-4757-bf9b-7443eaab6ea4 service nova] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:09:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:09:26 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Creating image(s)
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Ensure instance console log exists: /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start _get_guest_xml network_info=[{"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dcf293a9-cc1b-4890-96da-6b5f18b0dddd', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66439d36-425e-43cd-a932-2ab553f840c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'serial': 'f0fce950-c37f-4bcc-9649-7d58a4fcebe2'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:09:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 23:09:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.objects.instance [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66439d36-425e-43cd-a932-2ab553f840c5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:09:26 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:09:26 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:09:26 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d31106-f6cb-4e38-b8c6-91642afba5ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:09:26 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d0548-1f0b-4eed-bf0f-e609b6f5a931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2] added
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eebabac-b212-4ee1-8acf-be5098034165]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c0624-6df6-4aa0-9a59-37d234265bae]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKMsXEdg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKMsXEdg" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2eca4-046d-4574-964a-a6e3ca6865fb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKMsXEdg'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df362b-33c8-493b-8e41-3c2dea229d6e]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194eb82-58c5-4dc4-9ce2-c21dbe4c52b5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24a26d2-9de1-49f5-85d7-43e36eaaa346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]
Oct 25 23:09:26 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[81950625-37d7-40f3-b7fa-60f120a14936]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[458d1160-35f4-46a6-821c-19ef5c5c6701]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:26 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:09:26 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b39cc-adb7-422a-897a-6495c0607a17]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:09:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23733643739653961', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643739653961', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1364832038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:09:27 user nova-compute[74507]:   <uuid>66439d36-425e-43cd-a932-2ab553f840c5</uuid>
Oct 25 23:09:27 user nova-compute[74507]:   <name>instance-00000026</name>
Oct 25 23:09:27 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:09:27 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:09:27 user nova-compute[74507]:   <metadata>
Oct 25 23:09:27 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:09:27 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:09:27 user nova-compute[74507]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1364832038</nova:name>
Oct 25 23:09:27 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:09:26</nova:creationTime>
Oct 25 23:09:27 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:09:27 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:09:27 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:09:27 user nova-compute[74507]:       <nova:owner>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:user uuid="8822d9d3b9cc4c1283631390d6b14b02">tempest-ServerActionsV293TestJSON-1930328480-project-member</nova:user>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:project uuid="30598a8d1f8543d7a59a4a824bacbe8f">tempest-ServerActionsV293TestJSON-1930328480</nova:project>
Oct 25 23:09:27 user nova-compute[74507]:       </nova:owner>
Oct 25 23:09:27 user nova-compute[74507]:       <nova:ports>
Oct 25 23:09:27 user nova-compute[74507]:         <nova:port uuid="b24478f9-98a5-4c98-af2f-a65350649a17">
Oct 25 23:09:27 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 23:09:27 user nova-compute[74507]:         </nova:port>
Oct 25 23:09:27 user nova-compute[74507]:       </nova:ports>
Oct 25 23:09:27 user nova-compute[74507]:     </nova:instance>
Oct 25 23:09:27 user nova-compute[74507]:   </metadata>
Oct 25 23:09:27 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:09:27 user nova-compute[74507]:     <system>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="serial">66439d36-425e-43cd-a932-2ab553f840c5</entry>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="uuid">66439d36-425e-43cd-a932-2ab553f840c5</entry>
Oct 25 23:09:27 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:09:27 user nova-compute[74507]:     </system>
Oct 25 23:09:27 user nova-compute[74507]:   </sysinfo>
Oct 25 23:09:27 user nova-compute[74507]:   <os>
Oct 25 23:09:27 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:09:27 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:09:27 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:09:27 user nova-compute[74507]:   </os>
Oct 25 23:09:27 user nova-compute[74507]:   <features>
Oct 25 23:09:27 user nova-compute[74507]:     <acpi/>
Oct 25 23:09:27 user nova-compute[74507]:     <apic/>
Oct 25 23:09:27 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:09:27 user nova-compute[74507]:   </features>
Oct 25 23:09:27 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:09:27 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:09:27 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:09:27 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:09:27 user nova-compute[74507]:   </clock>
Oct 25 23:09:27 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:09:27 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:09:27 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:09:27 user nova-compute[74507]:   </cpu>
Oct 25 23:09:27 user nova-compute[74507]:   <devices>
Oct 25 23:09:27 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:09:27 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:09:27 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 23:09:27 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:09:27 user nova-compute[74507]:       <serial>f0fce950-c37f-4bcc-9649-7d58a4fcebe2</serial>
Oct 25 23:09:27 user nova-compute[74507]:     </disk>
Oct 25 23:09:27 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:09:27 user nova-compute[74507]:       <mac address="fa:16:3e:af:b4:f8"/>
Oct 25 23:09:27 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:09:27 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:09:27 user nova-compute[74507]:       <target dev="tapb24478f9-98"/>
Oct 25 23:09:27 user nova-compute[74507]:     </interface>
Oct 25 23:09:27 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:09:27 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5/console.log" append="off"/>
Oct 25 23:09:27 user nova-compute[74507]:     </serial>
Oct 25 23:09:27 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:09:27 user nova-compute[74507]:     <video>
Oct 25 23:09:27 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:09:27 user nova-compute[74507]:     </video>
Oct 25 23:09:27 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:09:27 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:09:27 user nova-compute[74507]:     </rng>
Oct 25 23:09:27 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:09:27 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:09:27 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:09:27 user nova-compute[74507]:     </memballoon>
Oct 25 23:09:27 user nova-compute[74507]:   </devices>
Oct 25 23:09:27 user nova-compute[74507]: </domain>
Oct 25 23:09:27 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1364832038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG os_vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2ef0b3d-f2df-5541-9da3-b99e06d4eed6', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24478f9-98, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb24478f9-98, col_values=(('qos', UUID('d56254c5-3d44-4c9d-a8e7-b1088d02a628')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb24478f9-98, col_values=(('external_ids', {'iface-id': 'b24478f9-98a5-4c98-af2f-a65350649a17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:b4:f8', 'vm-uuid': '66439d36-425e-43cd-a932-2ab553f840c5'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:28 user nova-compute[74507]: INFO os_vif [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98')
Oct 25 23:09:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:09:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] No VIF found with MAC fa:16:3e:af:b4:f8, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:29 user nova-compute[74507]: WARNING nova.compute.manager [req-21b294c5-5c12-4043-9571-f7fb135971bd req-55a6e6c8-80fb-4619-9a34-aed2204b1eb9 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 23:09:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:09:30 user nova-compute[74507]: INFO nova.compute.claims [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Claim successful on node user
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:09:30 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.policy [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:09:30 user nova-compute[74507]: INFO nova.virt.block_device [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Booting with volume 80ee4080-aa50-463e-a045-1a1456aaac0c at /dev/vda
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.utils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbcdc07-d959-400d-9428-bb3f79edb3c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b3127-438f-4ce9-a251-d2e6d9d6cafd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db1ad8-9d19-4e02-9353-40012a9de30a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb772975-bb2d-489d-8a2b-13553faa6400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:09:30 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:09:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e5cabe-b4c2-481b-a418-6142037aa9a8]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG os_brick.utils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:09:30 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updating existing volume attachment record: 306e6e32-ac82-4fdc-bdba-cab696e55057 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Successfully created port: f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:09:31 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance spawned successfully.
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.compute.manager [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:31 user nova-compute[74507]: WARNING nova.compute.manager [req-749b429c-3090-4a5b-817b-c263d1be9eb8 req-d1bdd98c-ba7c-4e32-9492-c5c44421a2b5 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.objects.instance [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74507) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-726d2df4-b3cb-4bf6-b934-3dfe494adaa8 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Successfully updated port: f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:09:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:09:32 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updating instance_info_cache with network_info: [{"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:32 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Instance network_info: |[{"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-changed-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG nova.compute.manager [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Refreshing instance network info cache due to event network-changed-f8854295-c8cf-498b-b9eb-387eac63f024. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] Acquiring lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] Acquired lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:33 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Refreshing network info cache for port f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:09:34 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updated VIF entry in instance network info cache for port f8854295-c8cf-498b-b9eb-387eac63f024. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:09:34 user nova-compute[74507]: DEBUG nova.network.neutron [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updating instance_info_cache with network_info: [{"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d5ce0496-303b-45e7-bc80-3cc46680f9a8 req-ec273160-c24b-4c02-aad8-61bea0ba734b service nova] Releasing lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:42 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 is timed out.
Oct 25 23:09:42 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully detached device vdb from instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 from the live domain config.
Oct 25 23:09:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQRMpxoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:09:42 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f612144-832b-4f73-956f-41338a51b715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:09:42 user nova-compute[74507]: No targets found.
Oct 25 23:09:42 user nova-compute[74507]: iSNS:
Oct 25 23:09:42 user nova-compute[74507]: No targets found.
Oct 25 23:09:42 user nova-compute[74507]: STATIC:
Oct 25 23:09:42 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:09:42 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:42 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:42 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:09:42 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:42 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:42 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:09:42 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:42 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:42 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e
Oct 25 23:09:42 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:09:42 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:09:42 user nova-compute[74507]: FIRMWARE:
Oct 25 23:09:42 user nova-compute[74507]: No targets found.
Oct 25 23:09:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:09:42 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:09:42 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee14b1-894f-4241-baf0-afc5cbf2b384]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c862bf-a440-4068-9b02-ce92ba009410]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:09:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e (non-flash)
Oct 25 23:09:42 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:09:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b546dcaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64073d82-eda6-433a-a6ab-2ac2aa2d1fa3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf9bb17-8d36-44f0-bcb3-42e8f3d6d1d3]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a441ac-f544-480d-8701-c0c4388d57dd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c2df4-905d-4e72-b92c-57f0a27a0869]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c90517-3035-492a-b739-9fd1be3275d2]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d8caf3-6127-4a7c-87d2-75356537cf41]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260]
Oct 25 23:09:42 user nova-compute[74507]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e, portal: 172.16.0.220,3260] successful.
Oct 25 23:09:42 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35cb8abc-d9e3-4c5e-8129-cbb157a70c5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8725419-a0e5-4dac-8ba0-8262059041d4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] <== disconnect_volume: return (342ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:09:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:09:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'flavor' on Instance uuid eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8469e125-fcbc-45c8-865e-1a3069c4add4 tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.886s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:09:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:09:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:09:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [{"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-eb4e946b-9ac6-49c7-809d-c2b15e0d8033" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:46 user nova-compute[74507]: INFO nova.compute.manager [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Terminating instance
Oct 25 23:09:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-unplugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] No waiting events found dispatching network-vif-unplugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-33f1e32e-6ae0-42ed-8cd1-d57a40e8ee20 req-7189620d-7683-4ec3-babd-b367b885dc90 service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-unplugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:09:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Instance destroyed successfully.
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.objects.instance [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'resources' on Instance uuid 1d685c29-b491-47bd-aebd-ecd45d3bef5b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499673683',display_name='tempest-AttachVolumeNegativeTest-server-1499673683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499673683',id=37,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIWjUyFDVnj84MYbsbzN5W320VcUe3/g16By8M8VwAxJBIpyjvhZMrKoUCDI1aG4YP98XMvs+IDWEM9WqMw/Az1gd3IRe+gu/ugMO0/7qBIo0yPo3vIL73Z+ssMaBnWug==',key_name='tempest-keypair-1786163975',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:06:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-zy3ia2kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=1d685c29-b491-47bd-aebd-ecd45d3bef5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "address": "fa:16:3e:76:80:33", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9b7ed8-80", "ovs_interfaceid": "ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG os_vif [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef9b7ed8-80, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e2eb0b3-fb55-419f-89d3-8312245ad005) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:47 user nova-compute[74507]: INFO os_vif [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:80:33,bridge_name='br-int',has_traffic_filtering=True,id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef9b7ed8-80')
Oct 25 23:09:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Deleting instance files /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b_del
Oct 25 23:09:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Deletion of /opt/stack/data/nova/instances/1d685c29-b491-47bd-aebd-ecd45d3bef5b_del complete
Oct 25 23:09:47 user nova-compute[74507]: INFO nova.compute.manager [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 25 23:09:47 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:09:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] Acquiring lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] No waiting events found dispatching network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:49 user nova-compute[74507]: WARNING nova.compute.manager [req-c1b80415-3946-4509-9f19-15a08a8422bb req-0635aded-1ea3-4b0d-a1c2-30da079262fe service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received unexpected event network-vif-plugged-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf for instance with vm_state active and task_state deleting.
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-ac84b9d8-1258-49ae-802d-0d0c47c8e92a req-278b61de-0334-429c-8fb2-cdc7e46c6d5b service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Received event network-vif-deleted-ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:49 user nova-compute[74507]: INFO nova.compute.manager [req-ac84b9d8-1258-49ae-802d-0d0c47c8e92a req-278b61de-0334-429c-8fb2-cdc7e46c6d5b service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Neutron deleted interface ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf; detaching it from the instance and deleting it from the info cache
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.network.neutron [req-ac84b9d8-1258-49ae-802d-0d0c47c8e92a req-278b61de-0334-429c-8fb2-cdc7e46c6d5b service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-ac84b9d8-1258-49ae-802d-0d0c47c8e92a req-278b61de-0334-429c-8fb2-cdc7e46c6d5b service nova] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Detach interface failed, port_id=ef9b7ed8-80d7-4fde-98be-bb8ab7b98edf, reason: Instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:09:49 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 1d685c29-b491-47bd-aebd-ecd45d3bef5b] Took 1.69 seconds to deallocate network for instance.
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:49 user nova-compute[74507]: INFO nova.compute.manager [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Terminating instance
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9d4b213-d233-4903-9cc8-2345c947db5b req-40791ce7-b16f-4918-8003-a190e89e49f3 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-unplugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:49 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Deleted allocations for instance 1d685c29-b491-47bd-aebd-ecd45d3bef5b
Oct 25 23:09:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91dd1696-b107-461b-af23-7e21944464a8 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "1d685c29-b491-47bd-aebd-ecd45d3bef5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Instance destroyed successfully.
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lazy-loading 'resources' on Instance uuid d7560741-7dcd-45bc-b9cb-aed2ffc5cf51 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1923410532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1923410532',id=33,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdVqVEnG1tvrbE8SC8UEexV7JtUnUaATUT4JKZpKC/7naF7IKNc9ZOj10wlChq4N7oMMJekJPGsCLRq8r1MXq1sxSgiUa9LSykPcKGD9svl+P52qMBHvPmTptt8X86yyg==',key_name='tempest-keypair-2023587710',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:08:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efbf59e935fe4170b38670efe09764dc',ramdisk_id='',reservation_id='r-0421j2yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2059391716',owner_user_name='tempest-AttachVolumeShelveTestJSON-2059391716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b81defc8e43843d3b14cc249f9e7dd73',uuid=d7560741-7dcd-45bc-b9cb-aed2ffc5cf51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converting VIF {"id": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "address": "fa:16:3e:be:4b:e3", "network": {"id": "700929b9-a6d9-4e44-9822-dc4930d47e9c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-848446056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efbf59e935fe4170b38670efe09764dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d436ee-d7", "ovs_interfaceid": "f5d436ee-d7f9-42a7-ae52-646b1a57c6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG os_vif [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5d436ee-d7, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dafe641e-2293-423f-bd12-9b8a85dbb464) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:50 user nova-compute[74507]: INFO os_vif [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:4b:e3,bridge_name='br-int',has_traffic_filtering=True,id=f5d436ee-d7f9-42a7-ae52-646b1a57c6c7,network=Network(700929b9-a6d9-4e44-9822-dc4930d47e9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d436ee-d7')
Oct 25 23:09:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Deleting instance files /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51_del
Oct 25 23:09:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Deletion of /opt/stack/data/nova/instances/d7560741-7dcd-45bc-b9cb-aed2ffc5cf51_del complete
Oct 25 23:09:50 user nova-compute[74507]: INFO nova.compute.manager [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:09:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:09:51 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Took 0.77 seconds to deallocate network for instance.
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-2b3e3b32-80da-477c-8cb7-eece9c8b1639 req-6c7d9f14-2d80-4685-8059-acf41e98d511 service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-deleted-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:09:51 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Deleted allocations for instance d7560741-7dcd-45bc-b9cb-aed2ffc5cf51
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6fd53bea-b8db-4843-92be-ef805db5fae4 tempest-AttachVolumeShelveTestJSON-2059391716 tempest-AttachVolumeShelveTestJSON-2059391716-project-member] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.442s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] Acquiring lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] Lock "d7560741-7dcd-45bc-b9cb-aed2ffc5cf51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] No waiting events found dispatching network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:09:51 user nova-compute[74507]: WARNING nova.compute.manager [req-f17dd717-c84e-4f21-aa05-ba8222754108 req-b3890a47-13eb-43e0-a3e4-43fdbec6f0fb service nova] [instance: d7560741-7dcd-45bc-b9cb-aed2ffc5cf51] Received unexpected event network-vif-plugged-f5d436ee-d7f9-42a7-ae52-646b1a57c6c7 for instance with vm_state deleted and task_state None.
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:09:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:09:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:09:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=24.76346206665039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 66439d36-425e-43cd-a932-2ab553f840c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d8c7170b-4b06-40cc-9268-fcf436b62d40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:09:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:09:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:09:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:09:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:09:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:10:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Creating image(s)
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Ensure instance console log exists: /opt/stack/data/nova/instances/d8c7170b-4b06-40cc-9268-fcf436b62d40/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Start _get_guest_xml network_info=[{"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '306e6e32-ac82-4fdc-bdba-cab696e55057', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd8c7170b-4b06-40cc-9268-fcf436b62d40', 'attached_at': '', 'detached_at': '', 'volume_id': '80ee4080-aa50-463e-a045-1a1456aaac0c', 'serial': '80ee4080-aa50-463e-a045-1a1456aaac0c'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:10:09 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:09 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:10:09 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:10:09 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:10:09 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edcd09-dfe7-4317-8a9d-d752e9c8feec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:10:09 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9378f3-8aca-45d7-882f-63e05646ff89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c] added
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4ab37-0897-4ff2-b112-509893cc0f63]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e68e6-461c-489a-a36f-c15e38780b9a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZRDhXQA {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZRDhXQA" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9231ee7-3b7b-4d25-8934-84290a73f7a0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZRDhXQA'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c727c68c-5a39-451c-a3b8-fc40ae4403cb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7d3c4-1402-4765-96f7-cf2493962cdf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a44fb1-1a5a-4ca4-ab9e-5c3c7e6ba61b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]
Oct 25 23:10:09 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f1c06-c9c9-4fef-820c-db3ff8d0c741]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c6af8-93b8-4fef-8c90-f1e8db34e1c7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:10:09 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:10:09 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3c162-97c9-4612-a9a0-0a2ff9e96063]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:10:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23637313266646565', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313266646565', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-403582591',display_name='tempest-TestVolumeBootPattern-server-403582591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-403582591',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0v2u24c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:09:31Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=d8c7170b-4b06-40cc-9268-fcf436b62d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid d8c7170b-4b06-40cc-9268-fcf436b62d40 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:10:10 user nova-compute[74507]:   <uuid>d8c7170b-4b06-40cc-9268-fcf436b62d40</uuid>
Oct 25 23:10:10 user nova-compute[74507]:   <name>instance-00000027</name>
Oct 25 23:10:10 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:10:10 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:10:10 user nova-compute[74507]:   <metadata>
Oct 25 23:10:10 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:10:10 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:10:10 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-server-403582591</nova:name>
Oct 25 23:10:10 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:10:09</nova:creationTime>
Oct 25 23:10:10 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:10:10 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:10:10 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:10:10 user nova-compute[74507]:       <nova:owner>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 23:10:10 user nova-compute[74507]:       </nova:owner>
Oct 25 23:10:10 user nova-compute[74507]:       <nova:ports>
Oct 25 23:10:10 user nova-compute[74507]:         <nova:port uuid="f8854295-c8cf-498b-b9eb-387eac63f024">
Oct 25 23:10:10 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 23:10:10 user nova-compute[74507]:         </nova:port>
Oct 25 23:10:10 user nova-compute[74507]:       </nova:ports>
Oct 25 23:10:10 user nova-compute[74507]:     </nova:instance>
Oct 25 23:10:10 user nova-compute[74507]:   </metadata>
Oct 25 23:10:10 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:10:10 user nova-compute[74507]:     <system>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="serial">d8c7170b-4b06-40cc-9268-fcf436b62d40</entry>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="uuid">d8c7170b-4b06-40cc-9268-fcf436b62d40</entry>
Oct 25 23:10:10 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:10:10 user nova-compute[74507]:     </system>
Oct 25 23:10:10 user nova-compute[74507]:   </sysinfo>
Oct 25 23:10:10 user nova-compute[74507]:   <os>
Oct 25 23:10:10 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:10:10 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:10:10 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:10:10 user nova-compute[74507]:   </os>
Oct 25 23:10:10 user nova-compute[74507]:   <features>
Oct 25 23:10:10 user nova-compute[74507]:     <acpi/>
Oct 25 23:10:10 user nova-compute[74507]:     <apic/>
Oct 25 23:10:10 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:10:10 user nova-compute[74507]:   </features>
Oct 25 23:10:10 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:10:10 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:10:10 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:10:10 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:10:10 user nova-compute[74507]:   </clock>
Oct 25 23:10:10 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:10:10 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:10:10 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:10:10 user nova-compute[74507]:   </cpu>
Oct 25 23:10:10 user nova-compute[74507]:   <devices>
Oct 25 23:10:10 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:10:10 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:10:10 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 23:10:10 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:10:10 user nova-compute[74507]:       <serial>80ee4080-aa50-463e-a045-1a1456aaac0c</serial>
Oct 25 23:10:10 user nova-compute[74507]:     </disk>
Oct 25 23:10:10 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:10:10 user nova-compute[74507]:       <mac address="fa:16:3e:42:b6:ee"/>
Oct 25 23:10:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:10:10 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:10:10 user nova-compute[74507]:       <target dev="tapf8854295-c8"/>
Oct 25 23:10:10 user nova-compute[74507]:     </interface>
Oct 25 23:10:10 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:10:10 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/d8c7170b-4b06-40cc-9268-fcf436b62d40/console.log" append="off"/>
Oct 25 23:10:10 user nova-compute[74507]:     </serial>
Oct 25 23:10:10 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:10:10 user nova-compute[74507]:     <video>
Oct 25 23:10:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:10:10 user nova-compute[74507]:     </video>
Oct 25 23:10:10 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:10:10 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:10:10 user nova-compute[74507]:     </rng>
Oct 25 23:10:10 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:10:10 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:10:10 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:10:10 user nova-compute[74507]:     </memballoon>
Oct 25 23:10:10 user nova-compute[74507]:   </devices>
Oct 25 23:10:10 user nova-compute[74507]: </domain>
Oct 25 23:10:10 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-403582591',display_name='tempest-TestVolumeBootPattern-server-403582591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-403582591',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0v2u24c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:09:31Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=d8c7170b-4b06-40cc-9268-fcf436b62d40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG os_vif [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f3bd72e-3c53-536c-93ff-2b0a673f89ca', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8854295-c8, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8854295-c8, col_values=(('qos', UUID('f49d22dd-5c91-4da7-8052-0dae14602e7a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8854295-c8, col_values=(('external_ids', {'iface-id': 'f8854295-c8cf-498b-b9eb-387eac63f024', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:b6:ee', 'vm-uuid': 'd8c7170b-4b06-40cc-9268-fcf436b62d40'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:10 user nova-compute[74507]: INFO os_vif [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8')
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:10:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:42:b6:ee, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:10:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] No waiting events found dispatching network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:12 user nova-compute[74507]: WARNING nova.compute.manager [req-6c456c4f-0519-45e0-995e-18c764fc4447 req-5c401ea6-f0d5-41c3-9bbb-2ab93bc65773 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received unexpected event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 for instance with vm_state building and task_state spawning.
Oct 25 23:10:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:10:14 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Instance spawned successfully.
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] No waiting events found dispatching network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:14 user nova-compute[74507]: WARNING nova.compute.manager [req-d9cc59a2-6034-488d-a507-56ff218eef0d req-61123411-d218-419c-8fd3-ea92cc36f701 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received unexpected event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 for instance with vm_state building and task_state spawning.
Oct 25 23:10:14 user nova-compute[74507]: INFO nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 25 23:10:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:10:14 user nova-compute[74507]: INFO nova.compute.manager [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Took 44.35 seconds to build instance.
Oct 25 23:10:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a4d63da-59d2-483f-bb99-f1c0001b053b tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.470s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:22 user nova-compute[74507]: INFO nova.compute.manager [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Terminating instance
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.compute.manager [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-276b3da0-8b23-4900-ae33-bb017a786909 req-d82de09d-b262-4927-98ae-0500810e33a4 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-unplugged-def5828a-3040-4afc-9400-01d473d69921 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:10:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Instance destroyed successfully.
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lazy-loading 'resources' on Instance uuid eb4e946b-9ac6-49c7-809d-c2b15e0d8033 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1900434321',display_name='tempest-TestMinimumBasicScenario-server-1900434321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1900434321',id=34,image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzfsUG2/hbp0kWury4g+Bf5djfywQXFl/0qWVoXExYVLdPtok3WcZpvDkVrerb6G1v2sOVvI9nKa/jBBifi6lwrTkFEyCi64aOGPaYmASb3PelKHbObDB11qifJtHHe/Q==',key_name='tempest-TestMinimumBasicScenario-744159838',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eb3fed6110e44d6ba6922cf016d07e8',ramdisk_id='',reservation_id='r-cre922a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98b833a6-f163-46a7-9a48-fdcfd893f52b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1674517596',owner_user_name='tempest-TestMinimumBasicScenario-1674517596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:07:36Z,user_data=None,user_id='a2bd439fd8ec46f89ab4dba1021525d2',uuid=eb4e946b-9ac6-49c7-809d-c2b15e0d8033,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converting VIF {"id": "def5828a-3040-4afc-9400-01d473d69921", "address": "fa:16:3e:02:e7:bd", "network": {"id": "95a39b57-912e-43fa-8df4-d0f92e8fa49c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-254049277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eb3fed6110e44d6ba6922cf016d07e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef5828a-30", "ovs_interfaceid": "def5828a-3040-4afc-9400-01d473d69921", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG os_vif [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdef5828a-30, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c86b9ce-62e5-4f93-8840-9f507aba4d2a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:10:23 user nova-compute[74507]: INFO os_vif [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:e7:bd,bridge_name='br-int',has_traffic_filtering=True,id=def5828a-3040-4afc-9400-01d473d69921,network=Network(95a39b57-912e-43fa-8df4-d0f92e8fa49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef5828a-30')
Oct 25 23:10:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Deleting instance files /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033_del
Oct 25 23:10:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Deletion of /opt/stack/data/nova/instances/eb4e946b-9ac6-49c7-809d-c2b15e0d8033_del complete
Oct 25 23:10:23 user nova-compute[74507]: INFO nova.compute.manager [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 23:10:23 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f9a1b03-4cbb-4bc7-9d58-b0c1a3304b2d req-f08927c8-3e47-4ebd-af1c-81094ab62512 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-deleted-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:23 user nova-compute[74507]: INFO nova.compute.manager [req-0f9a1b03-4cbb-4bc7-9d58-b0c1a3304b2d req-f08927c8-3e47-4ebd-af1c-81094ab62512 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Neutron deleted interface def5828a-3040-4afc-9400-01d473d69921; detaching it from the instance and deleting it from the info cache
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.network.neutron [req-0f9a1b03-4cbb-4bc7-9d58-b0c1a3304b2d req-f08927c8-3e47-4ebd-af1c-81094ab62512 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:10:23 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Took 0.47 seconds to deallocate network for instance.
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-0f9a1b03-4cbb-4bc7-9d58-b0c1a3304b2d req-f08927c8-3e47-4ebd-af1c-81094ab62512 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Detach interface failed, port_id=def5828a-3040-4afc-9400-01d473d69921, reason: Instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:23 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:24 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Deleted allocations for instance eb4e946b-9ac6-49c7-809d-c2b15e0d8033
Oct 25 23:10:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-198811db-ca71-4586-bdfe-d1c221ea45ad tempest-TestMinimumBasicScenario-1674517596 tempest-TestMinimumBasicScenario-1674517596-project-member] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] Acquiring lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] Lock "eb4e946b-9ac6-49c7-809d-c2b15e0d8033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] No waiting events found dispatching network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:24 user nova-compute[74507]: WARNING nova.compute.manager [req-083c566f-aebf-4d50-876f-ae386a646612 req-923f096e-3e4f-4c06-94df-1f271b50e1b8 service nova] [instance: eb4e946b-9ac6-49c7-809d-c2b15e0d8033] Received unexpected event network-vif-plugged-def5828a-3040-4afc-9400-01d473d69921 for instance with vm_state deleted and task_state None.
Oct 25 23:10:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:10:41 user nova-compute[74507]: INFO nova.compute.claims [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Claim successful on node user
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:10:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.policy [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b65985ef3b8403da48b609e49da19db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63880132a8984ca2bdfb3e226b65a093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:10:41 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Creating image(s)
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "/opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.187s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk 1073741824" returned: 0 in 0.052s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:41 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Successfully created port: 6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Cannot resize image /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Ensure instance console log exists: /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Successfully updated port: 6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquired lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-changed-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Refreshing instance network info cache due to event network-changed-6decf402-321f-4e3c-a584-45ce097d4c2b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] Acquiring lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:10:42 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.neutron [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating instance_info_cache with network_info: [{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Releasing lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Instance network_info: |[{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] Acquired lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.neutron [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Refreshing network info cache for port 6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Start _get_guest_xml network_info=[{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:10:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1138639446',display_name='tempest-AttachVolumeNegativeTest-server-1138639446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1138639446',id=40,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUV7bh8tTjzEw7KDURiddDwq9P/EA3cUtUp3DV61EmTCjyOoJi+ZyFwTh5WpvLWI2kIsYaBl0QOY+j7gG4ih7Mb0AJ2p6DoKe4xTHDNqgWer4kHbNf9zT5JUM6VBvT+UQ==',key_name='tempest-keypair-398165375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-uh03mtqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=f6615f1d-e572-4f50-994d-b0ac31bc2756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'pci_devices' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:10:43 user nova-compute[74507]:   <uuid>f6615f1d-e572-4f50-994d-b0ac31bc2756</uuid>
Oct 25 23:10:43 user nova-compute[74507]:   <name>instance-00000028</name>
Oct 25 23:10:43 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:10:43 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:10:43 user nova-compute[74507]:   <metadata>
Oct 25 23:10:43 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:10:43 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1138639446</nova:name>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:10:43</nova:creationTime>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:10:43 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:10:43 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:owner>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:user uuid="8b65985ef3b8403da48b609e49da19db">tempest-AttachVolumeNegativeTest-231270075-project-member</nova:user>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:project uuid="63880132a8984ca2bdfb3e226b65a093">tempest-AttachVolumeNegativeTest-231270075</nova:project>
Oct 25 23:10:43 user nova-compute[74507]:       </nova:owner>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:10:43 user nova-compute[74507]:       <nova:ports>
Oct 25 23:10:43 user nova-compute[74507]:         <nova:port uuid="6decf402-321f-4e3c-a584-45ce097d4c2b">
Oct 25 23:10:43 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 23:10:43 user nova-compute[74507]:         </nova:port>
Oct 25 23:10:43 user nova-compute[74507]:       </nova:ports>
Oct 25 23:10:43 user nova-compute[74507]:     </nova:instance>
Oct 25 23:10:43 user nova-compute[74507]:   </metadata>
Oct 25 23:10:43 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:10:43 user nova-compute[74507]:     <system>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="serial">f6615f1d-e572-4f50-994d-b0ac31bc2756</entry>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="uuid">f6615f1d-e572-4f50-994d-b0ac31bc2756</entry>
Oct 25 23:10:43 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:10:43 user nova-compute[74507]:     </system>
Oct 25 23:10:43 user nova-compute[74507]:   </sysinfo>
Oct 25 23:10:43 user nova-compute[74507]:   <os>
Oct 25 23:10:43 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:10:43 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:10:43 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:10:43 user nova-compute[74507]:   </os>
Oct 25 23:10:43 user nova-compute[74507]:   <features>
Oct 25 23:10:43 user nova-compute[74507]:     <acpi/>
Oct 25 23:10:43 user nova-compute[74507]:     <apic/>
Oct 25 23:10:43 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:10:43 user nova-compute[74507]:   </features>
Oct 25 23:10:43 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:10:43 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:10:43 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:10:43 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:10:43 user nova-compute[74507]:   </clock>
Oct 25 23:10:43 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:10:43 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:10:43 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:10:43 user nova-compute[74507]:   </cpu>
Oct 25 23:10:43 user nova-compute[74507]:   <devices>
Oct 25 23:10:43 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:10:43 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:10:43 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk"/>
Oct 25 23:10:43 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:10:43 user nova-compute[74507]:     </disk>
Oct 25 23:10:43 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:10:43 user nova-compute[74507]:       <mac address="fa:16:3e:62:b9:a5"/>
Oct 25 23:10:43 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:10:43 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:10:43 user nova-compute[74507]:       <target dev="tap6decf402-32"/>
Oct 25 23:10:43 user nova-compute[74507]:     </interface>
Oct 25 23:10:43 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:10:43 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/console.log" append="off"/>
Oct 25 23:10:43 user nova-compute[74507]:     </serial>
Oct 25 23:10:43 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:10:43 user nova-compute[74507]:     <video>
Oct 25 23:10:43 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:10:43 user nova-compute[74507]:     </video>
Oct 25 23:10:43 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:10:43 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:10:43 user nova-compute[74507]:     </rng>
Oct 25 23:10:43 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:10:43 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:10:43 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:10:43 user nova-compute[74507]:     </memballoon>
Oct 25 23:10:43 user nova-compute[74507]:   </devices>
Oct 25 23:10:43 user nova-compute[74507]: </domain>
Oct 25 23:10:43 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1138639446',display_name='tempest-AttachVolumeNegativeTest-server-1138639446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1138639446',id=40,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUV7bh8tTjzEw7KDURiddDwq9P/EA3cUtUp3DV61EmTCjyOoJi+ZyFwTh5WpvLWI2kIsYaBl0QOY+j7gG4ih7Mb0AJ2p6DoKe4xTHDNqgWer4kHbNf9zT5JUM6VBvT+UQ==',key_name='tempest-keypair-398165375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-uh03mtqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:10:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=f6615f1d-e572-4f50-994d-b0ac31bc2756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG os_vif [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03f6e4ce-e626-5a3e-8733-921edee25817', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6decf402-32, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6decf402-32, col_values=(('qos', UUID('cafa8790-1cf6-4375-8877-c683776e347e')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6decf402-32, col_values=(('external_ids', {'iface-id': '6decf402-321f-4e3c-a584-45ce097d4c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:b9:a5', 'vm-uuid': 'f6615f1d-e572-4f50-994d-b0ac31bc2756'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:43 user nova-compute[74507]: INFO os_vif [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32')
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:62:b9:a5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.neutron [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updated VIF entry in instance network info cache for port 6decf402-321f-4e3c-a584-45ce097d4c2b. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG nova.network.neutron [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating instance_info_cache with network_info: [{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:10:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-831e3b6d-19e7-4f46-9ec8-c902c90ca598 req-27ac3cfc-c835-4cfc-a71f-7a1c4464d31a service nova] Releasing lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] No waiting events found dispatching network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:44 user nova-compute[74507]: WARNING nova.compute.manager [req-488fa31c-5f30-4336-9303-6f34c7a02773 req-0dbd8f7c-3279-4c4f-96d7-f253d16d6ee9 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received unexpected event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b for instance with vm_state building and task_state spawning.
Oct 25 23:10:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:10:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:10:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [{"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:10:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-50c79d76-a840-4ae4-9425-03993a3c3e5e" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:10:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:10:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:10:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:10:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Instance spawned successfully.
Oct 25 23:10:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] No waiting events found dispatching network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:10:47 user nova-compute[74507]: WARNING nova.compute.manager [req-3fbd54c4-fc58-4b4f-ae98-5621aa09b0b4 req-ec262493-33e7-4067-9bee-19b34bbda145 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received unexpected event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b for instance with vm_state building and task_state spawning.
Oct 25 23:10:47 user nova-compute[74507]: INFO nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 25 23:10:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:10:47 user nova-compute[74507]: INFO nova.compute.manager [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Took 6.25 seconds to build instance.
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-28967697-a0fc-4da0-a9d0-8f7b904bb011 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:10:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:10:54 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:54 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=24.763351440429688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 8bbaa172-1185-436c-a935-f1b8bc337801 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance bfaca483-bad0-4b7e-a6cf-74998913ba30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 66439d36-425e-43cd-a932-2ab553f840c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance d8c7170b-4b06-40cc-9268-fcf436b62d40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance f6615f1d-e572-4f50-994d-b0ac31bc2756 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:10:54 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:10:55 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:10:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:10:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:10:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:10:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:01 user nova-compute[74507]: INFO nova.compute.manager [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Terminating instance
Oct 25 23:11:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-2a08cbf7-e60c-4545-bdfd-552fc36b5780 req-e293b9e9-9274-4837-8cda-87281c066aeb service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-unplugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:11:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Instance destroyed successfully.
Oct 25 23:11:01 user nova-compute[74507]: DEBUG nova.objects.instance [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid bfaca483-bad0-4b7e-a6cf-74998913ba30 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1995183307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1995183307',id=36,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-0p3bx0ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:09:15Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=bfaca483-bad0-4b7e-a6cf-74998913ba30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "address": "fa:16:3e:65:73:a9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadc810bd-8a", "ovs_interfaceid": "adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_vif [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadc810bd-8a, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a4e9f94-b5ee-4127-ba06-2e275cf9bfed) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: INFO os_vif [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:73:a9,bridge_name='br-int',has_traffic_filtering=True,id=adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadc810bd-8a')
Oct 25 23:11:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozKFfWLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:11:02 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0dc09-35ea-4156-9f46-aeb5cb6844c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:11:02 user nova-compute[74507]: No targets found.
Oct 25 23:11:02 user nova-compute[74507]: iSNS:
Oct 25 23:11:02 user nova-compute[74507]: No targets found.
Oct 25 23:11:02 user nova-compute[74507]: STATIC:
Oct 25 23:11:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:11:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:11:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:11:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:02 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604
Oct 25 23:11:02 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:02 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:02 user nova-compute[74507]: FIRMWARE:
Oct 25 23:11:02 user nova-compute[74507]: No targets found.
Oct 25 23:11:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:11:02 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:11:02 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7fd16-7898-4916-8028-3957103594ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11def9e-6a4f-4d10-92c8-0924c5357ae0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:11:02 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64307ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604'): ({'sde'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Removing single pathed devices sde {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d951d568-72cd-46cc-ba04-957f34171eab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68042f1-f387-4c74-b9b9-738cb0835bf8]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flushing IO for device /dev/sde {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a806e-f21b-4b5f-bacd-2e76599233f6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094a109-09e0-4c13-8405-47a792fbf435]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] SCSI volumes sde have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO550af05-2cbd20216bce2aae', '/dev/disk/by-id/scsi-23263626432303231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_550af05') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ca993-660d-4513-a66b-12c79f0cf066]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba9936-8dad-4473-880c-9e8a5d039c43]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5dcd1-063a-40a7-b39b-b0f00f351b77]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260]
Oct 25 23:11:02 user nova-compute[74507]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604, portal: 172.16.0.220,3260] successful.
Oct 25 23:11:02 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4677aa72-1371-449a-814d-a2e9acd25604 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e597dc-91e4-4fbc-815f-a43564970188]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== disconnect_volume: return (336ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:11:02 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Deleting instance files /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30_del
Oct 25 23:11:02 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Deletion of /opt/stack/data/nova/instances/bfaca483-bad0-4b7e-a6cf-74998913ba30_del complete
Oct 25 23:11:02 user nova-compute[74507]: INFO nova.compute.manager [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 23:11:02 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:11:02 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:03 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Took 0.58 seconds to deallocate network for instance.
Oct 25 23:11:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-0aba70bc-3958-4096-9c21-5fee4bd2d61b req-4c68dd49-4eb6-4e8c-984e-6fb66f75892e service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-deleted-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] Acquiring lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] No waiting events found dispatching network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:03 user nova-compute[74507]: WARNING nova.compute.manager [req-c4e5cf68-4321-448b-80ee-f4a943de17af req-17ce97e1-9a12-4711-8ca6-0dbf9c94db6b service nova] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Received unexpected event network-vif-plugged-adc810bd-8a2d-4c7a-8bc1-f7808ab52a9d for instance with vm_state active and task_state deleting.
Oct 25 23:11:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:08 user nova-compute[74507]: INFO nova.compute.manager [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: bfaca483-bad0-4b7e-a6cf-74998913ba30] Took 5.93 seconds to detach 1 volumes for instance.
Oct 25 23:11:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:09 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:11:09 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:11:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:09 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Deleted allocations for instance bfaca483-bad0-4b7e-a6cf-74998913ba30
Oct 25 23:11:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-247d84ce-1226-41fb-8793-1bf28980bc16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "bfaca483-bad0-4b7e-a6cf-74998913ba30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.180s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:18 user nova-compute[74507]: INFO nova.compute.manager [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Terminating instance
Oct 25 23:11:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-a50ade23-6af1-4eba-9a65-d827bcc38f8a req-4795ec09-8699-403f-924b-0216a6e74d02 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-unplugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:11:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Instance destroyed successfully.
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lazy-loading 'resources' on Instance uuid 66439d36-425e-43cd-a932-2ab553f840c5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T23:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1364832038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1549329912',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOavRwuaRQaIMx5ckI/74+vwsHWXvxcKCS8ps6KQNuFTDw9FW/mZ9ZbCyhUH9igbm8mv3VFyF/sBfptbdslYXYegEWjH4qziHeQJ9Dbs/epIrP4/2n/tQBLMrEbGhjo1A==',key_name='tempest-keypair-26108878',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30598a8d1f8543d7a59a4a824bacbe8f',ramdisk_id='',reservation_id='r-iui0l8mk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1930328480',owner_user_name='tempest-ServerActionsV293TestJSON-1930328480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8822d9d3b9cc4c1283631390d6b14b02',uuid=66439d36-425e-43cd-a932-2ab553f840c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converting VIF {"id": "b24478f9-98a5-4c98-af2f-a65350649a17", "address": "fa:16:3e:af:b4:f8", "network": {"id": "ba322bfb-162e-4eb7-8964-bfa1edc4b17b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-578758077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30598a8d1f8543d7a59a4a824bacbe8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24478f9-98", "ovs_interfaceid": "b24478f9-98a5-4c98-af2f-a65350649a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_vif [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24478f9-98, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d56254c5-3d44-4c9d-a8e7-b1088d02a628) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:19 user nova-compute[74507]: INFO os_vif [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:b4:f8,bridge_name='br-int',has_traffic_filtering=True,id=b24478f9-98a5-4c98-af2f-a65350649a17,network=Network(ba322bfb-162e-4eb7-8964-bfa1edc4b17b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24478f9-98')
Oct 25 23:11:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKMsXEdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:11:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0cc8f-5e53-4a65-b81e-28241dd95466]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:11:19 user nova-compute[74507]: No targets found.
Oct 25 23:11:19 user nova-compute[74507]: iSNS:
Oct 25 23:11:19 user nova-compute[74507]: No targets found.
Oct 25 23:11:19 user nova-compute[74507]: STATIC:
Oct 25 23:11:19 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2
Oct 25 23:11:19 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:19 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:19 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:11:19 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:19 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:19 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:11:19 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:19 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:19 user nova-compute[74507]: FIRMWARE:
Oct 25 23:11:19 user nova-compute[74507]: No targets found.
Oct 25 23:11:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:11:19 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:11:19 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf07aec-1c07-43ca-9070-4e67533ccd22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8102e2-246b-44ea-a486-b4f6ad7a0233]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:19 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:11:19 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:19 user nova-compute[74507]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 (non-flash)
Oct 25 23:11:19 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:19 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54343f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b30a1-3f16-4b61-a063-a451e1dbaeff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e7da93-e7e5-4a04-adb7-66541ff153af]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b298c81-0df1-45b1-8d4c-a4621c969d2d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:11:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.112s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72c0479-b11b-4a65-9d57-63f74d8f96e8]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO53bb06d9-73d79e9a68705c38', '/dev/disk/by-id/scsi-23733643739653961', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53bb06d9') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:11:20 user nova-compute[74507]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23733643739653961
Oct 25 23:11:20 user nova-compute[74507]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_53bb06d9
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d8c40a-a214-46f3-8e49-70b5e2dbd7a7]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e70ac-74f1-491c-9c54-f4399ce1e0f5]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873b1e0-0b12-434d-8c37-e84298649723]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260]
Oct 25 23:11:20 user nova-compute[74507]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2, portal: 172.16.0.220,3260] successful.
Oct 25 23:11:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce950-c37f-4bcc-9649-7d58a4fcebe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae3cd21-9c43-47aa-b336-e85420f606ab]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] <== disconnect_volume: return (430ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:11:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deleting instance files /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5_del
Oct 25 23:11:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deletion of /opt/stack/data/nova/instances/66439d36-425e-43cd-a932-2ab553f840c5_del complete
Oct 25 23:11:20 user nova-compute[74507]: INFO nova.compute.manager [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 25 23:11:20 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:11:20 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:11:21 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:21 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Took 1.07 seconds to deallocate network for instance.
Oct 25 23:11:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] Acquiring lock "66439d36-425e-43cd-a932-2ab553f840c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] Lock "66439d36-425e-43cd-a932-2ab553f840c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] No waiting events found dispatching network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:21 user nova-compute[74507]: WARNING nova.compute.manager [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received unexpected event network-vif-plugged-b24478f9-98a5-4c98-af2f-a65350649a17 for instance with vm_state active and task_state deleting.
Oct 25 23:11:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-e6589197-0b96-4294-b483-9da8ddaf9222 req-4c00ecc8-a51a-4566-b72e-1a86e1db0e90 service nova] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Received event network-vif-deleted-b24478f9-98a5-4c98-af2f-a65350649a17 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-changed-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG nova.compute.manager [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Refreshing instance network info cache due to event network-changed-f8854295-c8cf-498b-b9eb-387eac63f024. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] Acquiring lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] Acquired lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:11:22 user nova-compute[74507]: DEBUG nova.network.neutron [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Refreshing network info cache for port f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:23 user nova-compute[74507]: INFO nova.compute.manager [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Terminating instance
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.network.neutron [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updated VIF entry in instance network info cache for port f8854295-c8cf-498b-b9eb-387eac63f024. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.network.neutron [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updating instance_info_cache with network_info: [{"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07562889-60f4-4ce7-a589-d6098a98892f req-c738dacb-5566-4b2d-afa7-7c05df329269 service nova] Releasing lock "refresh_cache-d8c7170b-4b06-40cc-9268-fcf436b62d40" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-unplugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] No waiting events found dispatching network-vif-unplugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.compute.manager [req-f6d5a4e5-2b5d-4250-9457-841e70b7eaca req-8e85faf7-c302-44a8-b943-0fb4d7b23218 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-unplugged-f8854295-c8cf-498b-b9eb-387eac63f024 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:11:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Instance destroyed successfully.
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid d8c7170b-4b06-40cc-9268-fcf436b62d40 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-403582591',display_name='tempest-TestVolumeBootPattern-server-403582591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-403582591',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:10:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-h0v2u24c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:10:14Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=d8c7170b-4b06-40cc-9268-fcf436b62d40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "f8854295-c8cf-498b-b9eb-387eac63f024", "address": "fa:16:3e:42:b6:ee", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8854295-c8", "ovs_interfaceid": "f8854295-c8cf-498b-b9eb-387eac63f024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG os_vif [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8854295-c8, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f49d22dd-5c91-4da7-8052-0dae14602e7a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:24 user nova-compute[74507]: INFO os_vif [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:b6:ee,bridge_name='br-int',has_traffic_filtering=True,id=f8854295-c8cf-498b-b9eb-387eac63f024,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8854295-c8')
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:11:24 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: INFO nova.compute.manager [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Took 2.73 seconds to detach 1 volumes for instance.
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] [instance: 66439d36-425e-43cd-a932-2ab553f840c5] Deleting volume: f0fce950-c37f-4bcc-9649-7d58a4fcebe2 {{(pid=74507) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a26e4-f1c1-4b19-9c4b-92bce277a583]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:11:24 user nova-compute[74507]: No targets found.
Oct 25 23:11:24 user nova-compute[74507]: iSNS:
Oct 25 23:11:24 user nova-compute[74507]: No targets found.
Oct 25 23:11:24 user nova-compute[74507]: STATIC:
Oct 25 23:11:24 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:11:24 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:24 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:24 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:11:24 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:11:24 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:11:24 user nova-compute[74507]: FIRMWARE:
Oct 25 23:11:24 user nova-compute[74507]: No targets found.
Oct 25 23:11:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:11:24 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:11:24 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdbc79-d8b8-4247-9b6c-5d2a5ace0327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ab8f7-63bb-43ff-9123-a3ba7b411b70]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:24 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:11:24 user nova-compute[74507]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:11:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54347f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67eba80-6dcc-41e8-ae23-aca1c36b9b5e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[627dd436-6c2f-4b94-b2fc-2bd284c622ff]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89781bf2-82b3-4302-a246-30b2c2d796b8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010b29e-5f4e-4ddd-bed1-0e4b9c735e8f]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_feb0bcb9',) {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d0e38-5b19-42d0-b390-e5a0eb9ed065]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb8bbd1-da33-42d0-b457-df5e4c2f586c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb740443-d566-46e3-9dd4-07c29eee256a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]
Oct 25 23:11:24 user nova-compute[74507]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.
Oct 25 23:11:24 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[878d0819-736e-452c-9f4c-5eaf0bd66a3c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (347ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:11:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Deleting instance files /opt/stack/data/nova/instances/d8c7170b-4b06-40cc-9268-fcf436b62d40_del
Oct 25 23:11:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Deletion of /opt/stack/data/nova/instances/d8c7170b-4b06-40cc-9268-fcf436b62d40_del complete
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:24 user nova-compute[74507]: INFO nova.compute.manager [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:11:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:11:24 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Deleted allocations for instance 66439d36-425e-43cd-a932-2ab553f840c5
Oct 25 23:11:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8eed4b24-c025-444a-ba1a-1fdae1adf566 tempest-ServerActionsV293TestJSON-1930328480 tempest-ServerActionsV293TestJSON-1930328480-project-member] Lock "66439d36-425e-43cd-a932-2ab553f840c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.677s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:25 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Took 0.87 seconds to deallocate network for instance.
Oct 25 23:11:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-ec96c769-4996-4e3b-ad8b-5645f4dbd5e0 req-6e74848a-3df5-4f58-8881-5426c38fd7dc service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-deleted-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] Acquiring lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] No waiting events found dispatching network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:25 user nova-compute[74507]: WARNING nova.compute.manager [req-fe6a7c47-6c70-4afc-829c-3ac52a8d0104 req-719a07be-dce5-4a82-8828-acf1a7adf157 service nova] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Received unexpected event network-vif-plugged-f8854295-c8cf-498b-b9eb-387eac63f024 for instance with vm_state active and task_state deleting.
Oct 25 23:11:26 user nova-compute[74507]: INFO nova.compute.manager [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: d8c7170b-4b06-40cc-9268-fcf436b62d40] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 23:11:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:26 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:11:26 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:11:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:26 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance d8c7170b-4b06-40cc-9268-fcf436b62d40
Oct 25 23:11:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-47f6127c-c2d5-4434-87fa-71a7374e1d41 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "d8c7170b-4b06-40cc-9268-fcf436b62d40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.424s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:11:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:46 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:11:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:11:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:11:46 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [{"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-2b5116dc-7dd3-414b-89d6-9c318a41a63f" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:52 user nova-compute[74507]: INFO nova.compute.manager [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Terminating instance
Oct 25 23:11:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-unplugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] No waiting events found dispatching network-vif-unplugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG nova.compute.manager [req-a6b3defc-55ef-4754-81e1-b8a63db5812a req-87c5b0ca-e058-4121-97d1-2f4b6464ed7f service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-unplugged-ef1a384f-e06f-4df7-87c5-344d40612b40 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Instance destroyed successfully.
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid 8bbaa172-1185-436c-a935-f1b8bc337801 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222146002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222146002',id=30,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-oa5pvw5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:04:25Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=8bbaa172-1185-436c-a935-f1b8bc337801,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "ef1a384f-e06f-4df7-87c5-344d40612b40", "address": "fa:16:3e:55:2a:b1", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1a384f-e0", "ovs_interfaceid": "ef1a384f-e06f-4df7-87c5-344d40612b40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG os_vif [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1a384f-e0, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d1be765-4caa-43ff-accf-9aee3d5da5a4) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:11:53 user nova-compute[74507]: INFO os_vif [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:2a:b1,bridge_name='br-int',has_traffic_filtering=True,id=ef1a384f-e06f-4df7-87c5-344d40612b40,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1a384f-e0')
Oct 25 23:11:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Deleting instance files /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801_del
Oct 25 23:11:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Deletion of /opt/stack/data/nova/instances/8bbaa172-1185-436c-a935-f1b8bc337801_del complete
Oct 25 23:11:53 user nova-compute[74507]: INFO nova.compute.manager [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 23:11:53 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:11:53 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Took 0.47 seconds to deallocate network for instance.
Oct 25 23:11:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:11:53 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:54 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Deleted allocations for instance 8bbaa172-1185-436c-a935-f1b8bc337801
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5959b5be-c530-41b5-add1-4ba34c6aa4dd tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "8bbaa172-1185-436c-a935-f1b8bc337801" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] Acquiring lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] Lock "8bbaa172-1185-436c-a935-f1b8bc337801-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] No waiting events found dispatching network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:11:54 user nova-compute[74507]: WARNING nova.compute.manager [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received unexpected event network-vif-plugged-ef1a384f-e06f-4df7-87c5-344d40612b40 for instance with vm_state deleted and task_state None.
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.compute.manager [req-68286224-be55-4467-814d-76eee18da020 req-19292f05-f27a-4b40-a3eb-9bd779d7cc3c service nova] [instance: 8bbaa172-1185-436c-a935-f1b8bc337801] Received event network-vif-deleted-ef1a384f-e06f-4df7-87c5-344d40612b40 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:11:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:11:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:11:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:11:56 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=24.88824462890625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance f6615f1d-e572-4f50-994d-b0ac31bc2756 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:11:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:11:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:57 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:11:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:11:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:11:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:12:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:12:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:12:08 user nova-compute[74507]: INFO nova.compute.claims [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Claim successful on node user
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:12:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:12:08 user nova-compute[74507]: DEBUG nova.policy [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d05b04dc684a4db5d1055283fdbd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b9bdeae9415da4bf6c96bb4f7b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:12:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Creating image(s)
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "/opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "/opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "/opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk 1073741824" returned: 0 in 0.047s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.220s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Successfully created port: 1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Cannot resize image /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Ensure instance console log exists: /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Successfully updated port: 1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquired lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-changed-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Refreshing instance network info cache due to event network-changed-1666fe49-435e-43c4-8104-636eb351625d. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] Acquiring lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.neutron [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating instance_info_cache with network_info: [{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Releasing lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Instance network_info: |[{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] Acquired lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.neutron [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Refreshing network info cache for port 1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Start _get_guest_xml network_info=[{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:12:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1841330472',display_name='tempest-VolumesSnapshotTestJSON-instance-1841330472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1841330472',id=41,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP2WyFfGPFqtSRO0CCstd6iAR9f/yfmrBv3BweZXtl93PzyfCO0w5timmXsgvGmYpoDnf/zymf8ScLGiYktFRxsVn4xYl/ITooR3JcmHrVMIj2IJgDPA9ggtkkdS1tfsg==',key_name='tempest-keypair-251123368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-hlywayco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=9acdaa56-8aa3-49ba-85d5-f728bdff2215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.objects.instance [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'pci_devices' on Instance uuid 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:12:10 user nova-compute[74507]:   <uuid>9acdaa56-8aa3-49ba-85d5-f728bdff2215</uuid>
Oct 25 23:12:10 user nova-compute[74507]:   <name>instance-00000029</name>
Oct 25 23:12:10 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:12:10 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:12:10 user nova-compute[74507]:   <metadata>
Oct 25 23:12:10 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:12:10 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1841330472</nova:name>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:12:10</nova:creationTime>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:12:10 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:12:10 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:owner>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:user uuid="60d05b04dc684a4db5d1055283fdbd74">tempest-VolumesSnapshotTestJSON-1984329490-project-member</nova:user>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:project uuid="1155b9bdeae9415da4bf6c96bb4f7b1c">tempest-VolumesSnapshotTestJSON-1984329490</nova:project>
Oct 25 23:12:10 user nova-compute[74507]:       </nova:owner>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:12:10 user nova-compute[74507]:       <nova:ports>
Oct 25 23:12:10 user nova-compute[74507]:         <nova:port uuid="1666fe49-435e-43c4-8104-636eb351625d">
Oct 25 23:12:10 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 23:12:10 user nova-compute[74507]:         </nova:port>
Oct 25 23:12:10 user nova-compute[74507]:       </nova:ports>
Oct 25 23:12:10 user nova-compute[74507]:     </nova:instance>
Oct 25 23:12:10 user nova-compute[74507]:   </metadata>
Oct 25 23:12:10 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:12:10 user nova-compute[74507]:     <system>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="serial">9acdaa56-8aa3-49ba-85d5-f728bdff2215</entry>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="uuid">9acdaa56-8aa3-49ba-85d5-f728bdff2215</entry>
Oct 25 23:12:10 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:12:10 user nova-compute[74507]:     </system>
Oct 25 23:12:10 user nova-compute[74507]:   </sysinfo>
Oct 25 23:12:10 user nova-compute[74507]:   <os>
Oct 25 23:12:10 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:12:10 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:12:10 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:12:10 user nova-compute[74507]:   </os>
Oct 25 23:12:10 user nova-compute[74507]:   <features>
Oct 25 23:12:10 user nova-compute[74507]:     <acpi/>
Oct 25 23:12:10 user nova-compute[74507]:     <apic/>
Oct 25 23:12:10 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:12:10 user nova-compute[74507]:   </features>
Oct 25 23:12:10 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:12:10 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:12:10 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:12:10 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:12:10 user nova-compute[74507]:   </clock>
Oct 25 23:12:10 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:12:10 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:12:10 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:12:10 user nova-compute[74507]:   </cpu>
Oct 25 23:12:10 user nova-compute[74507]:   <devices>
Oct 25 23:12:10 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:12:10 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:12:10 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk"/>
Oct 25 23:12:10 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:12:10 user nova-compute[74507]:     </disk>
Oct 25 23:12:10 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:12:10 user nova-compute[74507]:       <mac address="fa:16:3e:fc:81:14"/>
Oct 25 23:12:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:10 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:12:10 user nova-compute[74507]:       <target dev="tap1666fe49-43"/>
Oct 25 23:12:10 user nova-compute[74507]:     </interface>
Oct 25 23:12:10 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:12:10 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/console.log" append="off"/>
Oct 25 23:12:10 user nova-compute[74507]:     </serial>
Oct 25 23:12:10 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:12:10 user nova-compute[74507]:     <video>
Oct 25 23:12:10 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:10 user nova-compute[74507]:     </video>
Oct 25 23:12:10 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:12:10 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:12:10 user nova-compute[74507]:     </rng>
Oct 25 23:12:10 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:12:10 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:12:10 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:12:10 user nova-compute[74507]:     </memballoon>
Oct 25 23:12:10 user nova-compute[74507]:   </devices>
Oct 25 23:12:10 user nova-compute[74507]: </domain>
Oct 25 23:12:10 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1841330472',display_name='tempest-VolumesSnapshotTestJSON-instance-1841330472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1841330472',id=41,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP2WyFfGPFqtSRO0CCstd6iAR9f/yfmrBv3BweZXtl93PzyfCO0w5timmXsgvGmYpoDnf/zymf8ScLGiYktFRxsVn4xYl/ITooR3JcmHrVMIj2IJgDPA9ggtkkdS1tfsg==',key_name='tempest-keypair-251123368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-hlywayco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=9acdaa56-8aa3-49ba-85d5-f728bdff2215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG os_vif [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfc74c81-63dd-5765-ad39-7591923ab983', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1666fe49-43, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1666fe49-43, col_values=(('qos', UUID('8eb1320b-2703-4285-bacb-b9eeb54890cb')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1666fe49-43, col_values=(('external_ids', {'iface-id': '1666fe49-435e-43c4-8104-636eb351625d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:81:14', 'vm-uuid': '9acdaa56-8aa3-49ba-85d5-f728bdff2215'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:11 user nova-compute[74507]: INFO os_vif [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43')
Oct 25 23:12:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No VIF found with MAC fa:16:3e:fc:81:14, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updated VIF entry in instance network info cache for port 1666fe49-435e-43c4-8104-636eb351625d. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG nova.network.neutron [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating instance_info_cache with network_info: [{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b10d35ef-0c70-4e44-b8e8-ddf384bb8bbf req-7b4b2536-9e09-4057-b0c6-2c79150f38d6 service nova] Releasing lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:12 user nova-compute[74507]: DEBUG nova.compute.manager [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] No waiting events found dispatching network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:12 user nova-compute[74507]: WARNING nova.compute.manager [req-90e20f00-27a3-4222-8eaf-b173afa1cb2b req-b90e432b-c56d-412c-91ef-c8b6798e6995 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received unexpected event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d for instance with vm_state building and task_state spawning.
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] No waiting events found dispatching network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:14 user nova-compute[74507]: WARNING nova.compute.manager [req-02de5de5-0457-4a0c-98e4-c7f44df07f0b req-c1157a68-f2ef-4604-925e-eba5298ca9dd service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received unexpected event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d for instance with vm_state building and task_state spawning.
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:12:14 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Instance spawned successfully.
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:15 user nova-compute[74507]: INFO nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 25 23:12:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:12:15 user nova-compute[74507]: INFO nova.compute.manager [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Took 6.63 seconds to build instance.
Oct 25 23:12:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-81d6e5d5-a982-4efe-9b29-8d834d4c33ca tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.739s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:12:15 user nova-compute[74507]: INFO nova.compute.claims [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Claim successful on node user
Oct 25 23:12:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:12:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:12:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.policy [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:12:16 user nova-compute[74507]: INFO nova.virt.block_device [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Booting with volume 80ee4080-aa50-463e-a045-1a1456aaac0c at /dev/vda
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.utils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[32109c8a-ce51-4090-80bd-fd8878cf303d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82269e4-42fc-4fd5-8a1f-b4c1a0a7be38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03a869-1687-4b83-8701-e899a866b980]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[770cdc21-1132-462f-8b58-23048a009a34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:12:16 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3473179f-2ffc-4070-9c76-e44ed11d7702]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG os_brick.utils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating existing volume attachment record: 4d540140-9409-4243-884a-84a0a1ed6659 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:12:16 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Successfully created port: b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Successfully updated port: b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing instance network info cache due to event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] Acquiring lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Instance network_info: |[{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] Acquired lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:12:19 user nova-compute[74507]: DEBUG nova.network.neutron [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updated VIF entry in instance network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:12:19 user nova-compute[74507]: DEBUG nova.network.neutron [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9b2d1eab-a6ed-4388-802c-561cb4f52ea1 req-dd9a3eec-0733-4e04-bad8-28c4d6306e7a service nova] Releasing lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:12:23 user nova-compute[74507]: INFO nova.compute.claims [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Claim successful on node user
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:12:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:12:23 user nova-compute[74507]: DEBUG nova.policy [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '296b63e942ff4708941cc09ab8feb39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d19559e778f4a25b2764ae9a1d820a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:12:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Creating image(s)
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "/opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "/opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "/opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.185s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk 1073741824" returned: 0 in 0.051s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Successfully created port: 9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Cannot resize image /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Ensure instance console log exists: /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Successfully updated port: 9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquired lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-changed-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.compute.manager [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Refreshing instance network info cache due to event network-changed-9960019b-e423-443f-aa4a-2ef3e13b7e49. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] Acquiring lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.network.neutron [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Releasing lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Instance network_info: |[{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] Acquired lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.network.neutron [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Refreshing network info cache for port 9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:12:25 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Start _get_guest_xml network_info=[{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:12:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:26 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480507615',display_name='tempest-ServersNegativeTestJSON-server-1480507615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480507615',id=43,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-clf8j8td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:24Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=de575cf3-3998-4ca6-b46d-1ca07ee17ec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lazy-loading 'pci_devices' on Instance uuid de575cf3-3998-4ca6-b46d-1ca07ee17ec5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:12:26 user nova-compute[74507]:   <uuid>de575cf3-3998-4ca6-b46d-1ca07ee17ec5</uuid>
Oct 25 23:12:26 user nova-compute[74507]:   <name>instance-0000002b</name>
Oct 25 23:12:26 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:12:26 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:12:26 user nova-compute[74507]:   <metadata>
Oct 25 23:12:26 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:12:26 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:name>tempest-ServersNegativeTestJSON-server-1480507615</nova:name>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:12:26</nova:creationTime>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:12:26 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:12:26 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:owner>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:user uuid="296b63e942ff4708941cc09ab8feb39a">tempest-ServersNegativeTestJSON-343182396-project-member</nova:user>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:project uuid="8d19559e778f4a25b2764ae9a1d820a1">tempest-ServersNegativeTestJSON-343182396</nova:project>
Oct 25 23:12:26 user nova-compute[74507]:       </nova:owner>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:12:26 user nova-compute[74507]:       <nova:ports>
Oct 25 23:12:26 user nova-compute[74507]:         <nova:port uuid="9960019b-e423-443f-aa4a-2ef3e13b7e49">
Oct 25 23:12:26 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 23:12:26 user nova-compute[74507]:         </nova:port>
Oct 25 23:12:26 user nova-compute[74507]:       </nova:ports>
Oct 25 23:12:26 user nova-compute[74507]:     </nova:instance>
Oct 25 23:12:26 user nova-compute[74507]:   </metadata>
Oct 25 23:12:26 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:12:26 user nova-compute[74507]:     <system>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="serial">de575cf3-3998-4ca6-b46d-1ca07ee17ec5</entry>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="uuid">de575cf3-3998-4ca6-b46d-1ca07ee17ec5</entry>
Oct 25 23:12:26 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:12:26 user nova-compute[74507]:     </system>
Oct 25 23:12:26 user nova-compute[74507]:   </sysinfo>
Oct 25 23:12:26 user nova-compute[74507]:   <os>
Oct 25 23:12:26 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:12:26 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:12:26 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:12:26 user nova-compute[74507]:   </os>
Oct 25 23:12:26 user nova-compute[74507]:   <features>
Oct 25 23:12:26 user nova-compute[74507]:     <acpi/>
Oct 25 23:12:26 user nova-compute[74507]:     <apic/>
Oct 25 23:12:26 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:12:26 user nova-compute[74507]:   </features>
Oct 25 23:12:26 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:12:26 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:12:26 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:12:26 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:12:26 user nova-compute[74507]:   </clock>
Oct 25 23:12:26 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:12:26 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:12:26 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:12:26 user nova-compute[74507]:   </cpu>
Oct 25 23:12:26 user nova-compute[74507]:   <devices>
Oct 25 23:12:26 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:12:26 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:12:26 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk"/>
Oct 25 23:12:26 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:12:26 user nova-compute[74507]:     </disk>
Oct 25 23:12:26 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:12:26 user nova-compute[74507]:       <mac address="fa:16:3e:29:c5:24"/>
Oct 25 23:12:26 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:26 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:12:26 user nova-compute[74507]:       <target dev="tap9960019b-e4"/>
Oct 25 23:12:26 user nova-compute[74507]:     </interface>
Oct 25 23:12:26 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:12:26 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/console.log" append="off"/>
Oct 25 23:12:26 user nova-compute[74507]:     </serial>
Oct 25 23:12:26 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:12:26 user nova-compute[74507]:     <video>
Oct 25 23:12:26 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:26 user nova-compute[74507]:     </video>
Oct 25 23:12:26 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:12:26 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:12:26 user nova-compute[74507]:     </rng>
Oct 25 23:12:26 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:12:26 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:12:26 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:12:26 user nova-compute[74507]:     </memballoon>
Oct 25 23:12:26 user nova-compute[74507]:   </devices>
Oct 25 23:12:26 user nova-compute[74507]: </domain>
Oct 25 23:12:26 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480507615',display_name='tempest-ServersNegativeTestJSON-server-1480507615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480507615',id=43,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-clf8j8td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:24Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=de575cf3-3998-4ca6-b46d-1ca07ee17ec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG os_vif [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1f236e3-6c83-5b0c-9443-a30299283bbe', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9960019b-e4, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9960019b-e4, col_values=(('qos', UUID('30c0f5d2-2cf9-403e-ad53-640fbacfd76c')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9960019b-e4, col_values=(('external_ids', {'iface-id': '9960019b-e423-443f-aa4a-2ef3e13b7e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:c5:24', 'vm-uuid': 'de575cf3-3998-4ca6-b46d-1ca07ee17ec5'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:26 user nova-compute[74507]: INFO os_vif [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4')
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] No VIF found with MAC fa:16:3e:29:c5:24, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.neutron [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updated VIF entry in instance network info cache for port 9960019b-e423-443f-aa4a-2ef3e13b7e49. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG nova.network.neutron [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-fb8dbda8-f4e8-4bb3-8e9f-5efddc7181b7 req-82585ad4-522b-4104-b6c7-a5f734debe7b service nova] Releasing lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:27 user nova-compute[74507]: DEBUG nova.compute.manager [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:27 user nova-compute[74507]: WARNING nova.compute.manager [req-1f8214d1-d9f6-45e3-ad83-7ff921ffc48b req-ac83fc4b-a30f-4fb1-a339-58a0d3238ece service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state building and task_state spawning.
Oct 25 23:12:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:12:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Instance spawned successfully.
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:29 user nova-compute[74507]: INFO nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Took 5.83 seconds to spawn the instance on the hypervisor.
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:29 user nova-compute[74507]: WARNING nova.compute.manager [req-07075922-9e4f-432a-95e5-aa20ff7d3738 req-5908a008-2638-48c8-bda5-17369e368cf7 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state building and task_state spawning.
Oct 25 23:12:29 user nova-compute[74507]: INFO nova.compute.manager [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Took 6.54 seconds to build instance.
Oct 25 23:12:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a50826d9-9435-416e-9761-994043392178 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.646s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-changed-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Refreshing instance network info cache due to event network-changed-6decf402-321f-4e3c-a584-45ce097d4c2b. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] Acquiring lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] Acquired lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Refreshing network info cache for port 6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updated VIF entry in instance network info cache for port 6decf402-321f-4e3c-a584-45ce097d4c2b. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG nova.network.neutron [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating instance_info_cache with network_info: [{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-17cc1c41-c47e-4daa-ab7f-66717365f554 req-c83c55c3-9c85-466d-b308-94ade9213bed service nova] Releasing lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:12:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:38 user nova-compute[74507]: INFO nova.compute.manager [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Attaching volume 1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 to /dev/vdb
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.utils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f0d43-664a-498e-b16d-34868d31b8dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd9a898-2856-4304-b5ca-8ed7435f4007]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f28a39c-72ff-46e7-8d0e-6522b53ba9f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108ddbb-1596-4a8c-86ec-eaf02d583b99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:12:38 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:12:38 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826e93b-59bd-4dfd-b449-8a8b798c6b10]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG os_brick.utils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:12:38 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating existing volume attachment record: b5f8acd7-cc7f-41b3-8370-d938ff24cc84 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:12:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:42 user nova-compute[74507]: INFO nova.compute.manager [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Terminating instance
Oct 25 23:12:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-bda005fc-0f71-497b-aa46-b585922b9547 req-4ee04742-0dbd-4c46-b876-f9c551907214 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-unplugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Instance destroyed successfully.
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid 2b5116dc-7dd3-414b-89d6-9c318a41a63f {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-784031805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-784031805',id=23,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-67n5t0ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:00:40Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=2b5116dc-7dd3-414b-89d6-9c318a41a63f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "address": "fa:16:3e:bc:0e:c9", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape304d3b5-34", "ovs_interfaceid": "e304d3b5-349e-4908-a1c6-bb3ed2d92698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_vif [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape304d3b5-34, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=832a1632-575b-47cc-a272-f39b9fe74eb1) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:43 user nova-compute[74507]: INFO os_vif [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:0e:c9,bridge_name='br-int',has_traffic_filtering=True,id=e304d3b5-349e-4908-a1c6-bb3ed2d92698,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape304d3b5-34')
Oct 25 23:12:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVFkNHid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:12:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fa003-5242-4486-9ec3-ff6a28595e8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:12:43 user nova-compute[74507]: No targets found.
Oct 25 23:12:43 user nova-compute[74507]: iSNS:
Oct 25 23:12:43 user nova-compute[74507]: No targets found.
Oct 25 23:12:43 user nova-compute[74507]: STATIC:
Oct 25 23:12:43 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede
Oct 25 23:12:43 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:12:43 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:12:43 user nova-compute[74507]: FIRMWARE:
Oct 25 23:12:43 user nova-compute[74507]: No targets found.
Oct 25 23:12:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:12:43 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:12:43 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22156e-0303-4eda-b13b-23dde628e2b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b0334-b17d-4b76-808d-4749d4e762a7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:12:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede (non-flash)
Oct 25 23:12:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b544ac310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811a7cf-7786-47d1-a0c3-65cb286b5842]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.102s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ec589-fa6f-44f0-b5af-92865995c4c7]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f35855-fd2c-4107-b0c7-1f8abaf5cbea]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f8b70-af5e-478a-ab53-d96f3b736cfe]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c378e0b6-3a43-4833-85f3-56d569271e1c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c852f9f5-0cad-4f79-ae4c-8535e75e90a2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260]
Oct 25 23:12:44 user nova-compute[74507]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede, portal: 172.16.0.220,3260] successful.
Oct 25 23:12:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c648b3e0-bbc4-4f43-ae33-78b1ed95fede -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a07ab-4cf7-4c87-b143-e3ca1ae27c81]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] <== disconnect_volume: return (388ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:12:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Deleting instance files /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f_del
Oct 25 23:12:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Deletion of /opt/stack/data/nova/instances/2b5116dc-7dd3-414b-89d6-9c318a41a63f_del complete
Oct 25 23:12:44 user nova-compute[74507]: INFO nova.compute.manager [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 25 23:12:44 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:12:44 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:12:44 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Took 0.52 seconds to deallocate network for instance.
Oct 25 23:12:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] Acquiring lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] No waiting events found dispatching network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:45 user nova-compute[74507]: WARNING nova.compute.manager [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received unexpected event network-vif-plugged-e304d3b5-349e-4908-a1c6-bb3ed2d92698 for instance with vm_state active and task_state deleting.
Oct 25 23:12:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-6508ac0e-23fc-46a0-92d3-28501a4a4e5d req-ad64c79b-7891-42a7-87d7-7e614d671206 service nova] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Received event network-vif-deleted-e304d3b5-349e-4908-a1c6-bb3ed2d92698 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:45 user nova-compute[74507]: INFO nova.compute.manager [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 2b5116dc-7dd3-414b-89d6-9c318a41a63f] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:45 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Deleted allocations for instance 2b5116dc-7dd3-414b-89d6-9c318a41a63f
Oct 25 23:12:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-505b9c5b-00dc-4572-aab9-4e97b8b4fa7f tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "2b5116dc-7dd3-414b-89d6-9c318a41a63f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.078s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 23:12:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:12:53 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Creating image(s)
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Start _get_guest_xml network_info=[{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d540140-9409-4243-884a-84a0a1ed6659', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5', 'attached_at': '', 'detached_at': '', 'volume_id': '80ee4080-aa50-463e-a045-1a1456aaac0c', 'serial': '80ee4080-aa50-463e-a045-1a1456aaac0c'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:12:53 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:53 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:12:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:12:53 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:12:53 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc22b36-fa5c-4ba5-928a-2ddd0e39f538]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:12:53 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da7b54-99ee-4c0b-add4-15f7adffd363]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c] added
Oct 25 23:12:53 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8591915b-9712-4186-8860-78d7c2bce167]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58db569-3bec-4eb9-aa31-54ddd24ec5f2]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZRDhXQA {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZRDhXQA" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3bbe09-ba27-4778-a8c0-f9ce49669919]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZRDhXQA'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6135c744-4db1-4729-bbe8-ba85fa0dfb34]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4f56c8-bee4-4df3-bbd7-e9e2d16c1286]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:12:54 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:12:54 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:12:54 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:12:54 user nova-compute[74507]: 
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[556054a9-b6c9-40fb-b6e8-82d29edcd78c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]
Oct 25 23:12:54 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.
Oct 25 23:12:54 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[69135a93-1670-4d64-887d-3cd60d618d83]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a40ace-e008-4be7-aaf3-fb1f03bfb52a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:54 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:54 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd46a0-f57a-4fdd-aa1c-4fcfa9eee790]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:12:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23637313266646565', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313266646565', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570501046',display_name='tempest-TestVolumeBootPattern-server-570501046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570501046',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-7i51u172',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:16Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:12:55 user nova-compute[74507]:   <uuid>b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5</uuid>
Oct 25 23:12:55 user nova-compute[74507]:   <name>instance-0000002a</name>
Oct 25 23:12:55 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:12:55 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:12:55 user nova-compute[74507]:   <metadata>
Oct 25 23:12:55 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:12:55 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:12:55 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-server-570501046</nova:name>
Oct 25 23:12:55 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:12:53</nova:creationTime>
Oct 25 23:12:55 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:12:55 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:12:55 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:12:55 user nova-compute[74507]:       <nova:owner>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 23:12:55 user nova-compute[74507]:       </nova:owner>
Oct 25 23:12:55 user nova-compute[74507]:       <nova:ports>
Oct 25 23:12:55 user nova-compute[74507]:         <nova:port uuid="b972505f-6f8a-43c8-8f84-8658f78f26ed">
Oct 25 23:12:55 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 23:12:55 user nova-compute[74507]:         </nova:port>
Oct 25 23:12:55 user nova-compute[74507]:       </nova:ports>
Oct 25 23:12:55 user nova-compute[74507]:     </nova:instance>
Oct 25 23:12:55 user nova-compute[74507]:   </metadata>
Oct 25 23:12:55 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:12:55 user nova-compute[74507]:     <system>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="serial">b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5</entry>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="uuid">b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5</entry>
Oct 25 23:12:55 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:12:55 user nova-compute[74507]:     </system>
Oct 25 23:12:55 user nova-compute[74507]:   </sysinfo>
Oct 25 23:12:55 user nova-compute[74507]:   <os>
Oct 25 23:12:55 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:12:55 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:12:55 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:12:55 user nova-compute[74507]:   </os>
Oct 25 23:12:55 user nova-compute[74507]:   <features>
Oct 25 23:12:55 user nova-compute[74507]:     <acpi/>
Oct 25 23:12:55 user nova-compute[74507]:     <apic/>
Oct 25 23:12:55 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:12:55 user nova-compute[74507]:   </features>
Oct 25 23:12:55 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:12:55 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:12:55 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:12:55 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:12:55 user nova-compute[74507]:   </clock>
Oct 25 23:12:55 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:12:55 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:12:55 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:12:55 user nova-compute[74507]:   </cpu>
Oct 25 23:12:55 user nova-compute[74507]:   <devices>
Oct 25 23:12:55 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:12:55 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:12:55 user nova-compute[74507]:       <source dev="/dev/sdb"/>
Oct 25 23:12:55 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:12:55 user nova-compute[74507]:       <serial>80ee4080-aa50-463e-a045-1a1456aaac0c</serial>
Oct 25 23:12:55 user nova-compute[74507]:     </disk>
Oct 25 23:12:55 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:12:55 user nova-compute[74507]:       <mac address="fa:16:3e:69:06:7c"/>
Oct 25 23:12:55 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:55 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:12:55 user nova-compute[74507]:       <target dev="tapb972505f-6f"/>
Oct 25 23:12:55 user nova-compute[74507]:     </interface>
Oct 25 23:12:55 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:12:55 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5/console.log" append="off"/>
Oct 25 23:12:55 user nova-compute[74507]:     </serial>
Oct 25 23:12:55 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:12:55 user nova-compute[74507]:     <video>
Oct 25 23:12:55 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:12:55 user nova-compute[74507]:     </video>
Oct 25 23:12:55 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:12:55 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:12:55 user nova-compute[74507]:     </rng>
Oct 25 23:12:55 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:12:55 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:12:55 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:12:55 user nova-compute[74507]:     </memballoon>
Oct 25 23:12:55 user nova-compute[74507]:   </devices>
Oct 25 23:12:55 user nova-compute[74507]: </domain>
Oct 25 23:12:55 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570501046',display_name='tempest-TestVolumeBootPattern-server-570501046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570501046',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-7i51u172',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:12:16Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG os_vif [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '707a1b1a-3577-5814-81e9-a81d8ca43d64', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb972505f-6f, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb972505f-6f, col_values=(('qos', UUID('c05a8bad-49b3-4f77-be9a-74c958307657')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb972505f-6f, col_values=(('external_ids', {'iface-id': 'b972505f-6f8a-43c8-8f84-8658f78f26ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:06:7c', 'vm-uuid': 'b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:55 user nova-compute[74507]: INFO os_vif [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f')
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:12:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:69:06:7c, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtpLQwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:12:56 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:12:56 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:12:56 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1987311-0d46-460d-b4d3-840edca3e016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:12:56 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a81f755-0681-4034-9fcc-ad1db044df3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6] added
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9856bda-eaa8-4e89-b422-4cd1b6375396]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc80dc-3b5d-475f-b13a-4b78a16374c3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbtpLQwH {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbtpLQwH" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273c1f8-c09e-4203-9dbd-4e45b53a1fec]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbtpLQwH'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[893bc284-3d9c-4ec0-b454-034c947ab50c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7fc7c6-557f-4f9d-82aa-3ca518aa22a6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d19357-1364-47bb-801f-624fe71be759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260]
Oct 25 23:12:56 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260] successful.
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71643c-1f81-4e2b-bc84-e2f401593d1d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f316089e-e6d2-4b2d-9840-f301eb39d003]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:56 user nova-compute[74507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:12:56 user nova-compute[74507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)
Oct 25 23:12:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4aeca2-263e-44b4-a04b-5e9096b22e00]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtpLQwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] No waiting events found dispatching network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:56 user nova-compute[74507]: WARNING nova.compute.manager [req-c876028d-bb54-41e1-9006-cbc3a803e3be req-ea9b253b-eae3-4db9-91f6-083bc20851ca service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received unexpected event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed for instance with vm_state building and task_state spawning.
Oct 25 23:12:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23865326333396637', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865326333396637', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:12:57 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:12:57 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:12:57 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:12:57 user nova-compute[74507]:   <serial>1a1a96c8-a093-4d8f-a15d-90c9006e8fe6</serial>
Oct 25 23:12:57 user nova-compute[74507]: </disk>
Oct 25 23:12:57 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:12:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] No VIF found with MAC fa:16:3e:62:b9:a5, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c962aaa6-d1e8-4a82-a796-c810f8a8b246 tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.842s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:12:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] No waiting events found dispatching network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:12:59 user nova-compute[74507]: WARNING nova.compute.manager [req-71489348-3417-4d5d-b330-5ad45d76d222 req-e056c66a-1827-4fb7-b8ff-5327578e21e1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received unexpected event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed for instance with vm_state building and task_state spawning.
Oct 25 23:12:59 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:59 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8313MB free_disk=24.82746124267578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Instance spawned successfully.
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.compute.manager [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Detaching volume 1a1a96c8-a093-4d8f-a15d-90c9006e8fe6
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.virt.block_device [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Attempting to driver detach volume 1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 from mountpoint /dev/vdb
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 50c79d76-a840-4ae4-9425-03993a3c3e5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance f6615f1d-e572-4f50-994d-b0ac31bc2756 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Attempting to detach device vdb from instance f6615f1d-e572-4f50-994d-b0ac31bc2756 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:12:59 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:12:59 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:12:59 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:12:59 user nova-compute[74507]:   <serial>1a1a96c8-a093-4d8f-a15d-90c9006e8fe6</serial>
Oct 25 23:12:59 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:12:59 user nova-compute[74507]: </disk>
Oct 25 23:12:59 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance f6615f1d-e572-4f50-994d-b0ac31bc2756 from the persistent domain config.
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6615f1d-e572-4f50-994d-b0ac31bc2756 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:12:59 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:12:59 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:12:59 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:12:59 user nova-compute[74507]:   <serial>1a1a96c8-a093-4d8f-a15d-90c9006e8fe6</serial>
Oct 25 23:12:59 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:12:59 user nova-compute[74507]: </disk>
Oct 25 23:12:59 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:12:59 user nova-compute[74507]: INFO nova.compute.manager [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Took 44.13 seconds to build instance.
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6dbb3f33-fb90-4cb5-aefe-e604aab7d47c tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.235s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:12:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:13:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:13:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:13:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:19 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6615f1d-e572-4f50-994d-b0ac31bc2756 is timed out.
Oct 25 23:13:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully detached device vdb from instance f6615f1d-e572-4f50-994d-b0ac31bc2756 from the live domain config.
Oct 25 23:13:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:13:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbtpLQwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:13:19 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:13:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:13:19 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:13:19 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e287a7-26ed-4ebb-87ad-a3dde5a40a81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:13:20 user nova-compute[74507]: No targets found.
Oct 25 23:13:20 user nova-compute[74507]: iSNS:
Oct 25 23:13:20 user nova-compute[74507]: No targets found.
Oct 25 23:13:20 user nova-compute[74507]: STATIC:
Oct 25 23:13:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6
Oct 25 23:13:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:13:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:13:20 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:13:20 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:13:20 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:13:20 user nova-compute[74507]: FIRMWARE:
Oct 25 23:13:20 user nova-compute[74507]: No targets found.
Oct 25 23:13:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:13:20 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:13:20 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e2891-35b2-4a44-a36c-9f8bb5b6359a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3878745-b07d-4b54-a63d-b535ca03d0bf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:13:20 user nova-compute[74507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)
Oct 25 23:13:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:13:20 user nova-compute[74507]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 (non-flash)
Oct 25 23:13:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54341a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3b8b95-9e4c-4682-b2db-aca0e44665de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c0e72-4e49-4278-a92d-8c5b56781879]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e584d8-6c92-47b8-a94e-9b3c85eac36f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae92f3-2a77-4ea8-9f3f-3accfc648464]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595257f-c79b-4f8b-89a1-37dd9cd7db1b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b8352-5e93-483b-9eff-2e2b1550509c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260]
Oct 25 23:13:20 user nova-compute[74507]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6, portal: 172.16.0.220,3260] successful.
Oct 25 23:13:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1a96c8-a093-4d8f-a15d-90c9006e8fe6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d09f3-8f0b-4429-a25f-6219f4416ca3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] <== disconnect_volume: return (303ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:13:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:21 user nova-compute[74507]: DEBUG nova.objects.instance [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'flavor' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:13:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-b9acef54-ad6e-4c38-b4e3-854a5c8b408e tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:33 user nova-compute[74507]: INFO nova.compute.manager [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Terminating instance
Oct 25 23:13:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-unplugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] No waiting events found dispatching network-vif-unplugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.compute.manager [req-94f2010a-a3bf-43f6-9677-a865e5339880 req-fee39995-166c-4597-acc6-fd12ae803bf9 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-unplugged-d10563e3-876d-4666-bed8-aefcf7f293c4 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:13:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Instance destroyed successfully.
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.objects.instance [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lazy-loading 'resources' on Instance uuid 50c79d76-a840-4ae4-9425-03993a3c3e5e {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T22:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157347298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157347298',id=20,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T22:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cdf2550d504422686b0a2a829758690',ramdisk_id='',reservation_id='r-qxqyp7dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T22:55:51Z,user_data=None,user_id='4da245cae18d400ab7b8c787bfd10156',uuid=50c79d76-a840-4ae4-9425-03993a3c3e5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converting VIF {"id": "d10563e3-876d-4666-bed8-aefcf7f293c4", "address": "fa:16:3e:23:19:cb", "network": {"id": "62e97c12-f3a5-4bf5-bb7b-3691c4ecb772", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-612425901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cdf2550d504422686b0a2a829758690", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd10563e3-87", "ovs_interfaceid": "d10563e3-876d-4666-bed8-aefcf7f293c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG os_vif [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd10563e3-87, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acee2978-412c-4bf4-9631-962b505a61de) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:34 user nova-compute[74507]: INFO os_vif [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:19:cb,bridge_name='br-int',has_traffic_filtering=True,id=d10563e3-876d-4666-bed8-aefcf7f293c4,network=Network(62e97c12-f3a5-4bf5-bb7b-3691c4ecb772),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd10563e3-87')
Oct 25 23:13:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Deleting instance files /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e_del
Oct 25 23:13:34 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Deletion of /opt/stack/data/nova/instances/50c79d76-a840-4ae4-9425-03993a3c3e5e_del complete
Oct 25 23:13:34 user nova-compute[74507]: INFO nova.compute.manager [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 23:13:34 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:13:34 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:13:34 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Took 0.45 seconds to deallocate network for instance.
Oct 25 23:13:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:35 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:13:35 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:13:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:35 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Deleted allocations for instance 50c79d76-a840-4ae4-9425-03993a3c3e5e
Oct 25 23:13:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-bc9f2c9a-04b9-45b8-9163-d15303826b16 tempest-ServerBootFromVolumeStableRescueTest-1413973068 tempest-ServerBootFromVolumeStableRescueTest-1413973068-project-member] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.721s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] Acquiring lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:36 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] Lock "50c79d76-a840-4ae4-9425-03993a3c3e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] No waiting events found dispatching network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:13:36 user nova-compute[74507]: WARNING nova.compute.manager [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received unexpected event network-vif-plugged-d10563e3-876d-4666-bed8-aefcf7f293c4 for instance with vm_state deleted and task_state None.
Oct 25 23:13:36 user nova-compute[74507]: DEBUG nova.compute.manager [req-071bc1a0-0693-4256-8a15-48f17cd80544 req-7bc7b639-9d1b-40d6-8c9d-380fc20a9882 service nova] [instance: 50c79d76-a840-4ae4-9425-03993a3c3e5e] Received event network-vif-deleted-d10563e3-876d-4666-bed8-aefcf7f293c4 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:13:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:46 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:13:48 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating instance_info_cache with network_info: [{"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-f6615f1d-e572-4f50-994d-b0ac31bc2756" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:49 user nova-compute[74507]: INFO nova.compute.manager [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Terminating instance
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-unplugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] No waiting events found dispatching network-vif-unplugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-4c1fb17e-43ea-4b75-bdc2-cb038b579071 req-160d179f-8f54-418f-b106-539314cad5c7 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-unplugged-6decf402-321f-4e3c-a584-45ce097d4c2b for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:13:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Instance destroyed successfully.
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.objects.instance [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lazy-loading 'resources' on Instance uuid f6615f1d-e572-4f50-994d-b0ac31bc2756 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1138639446',display_name='tempest-AttachVolumeNegativeTest-server-1138639446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1138639446',id=40,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUV7bh8tTjzEw7KDURiddDwq9P/EA3cUtUp3DV61EmTCjyOoJi+ZyFwTh5WpvLWI2kIsYaBl0QOY+j7gG4ih7Mb0AJ2p6DoKe4xTHDNqgWer4kHbNf9zT5JUM6VBvT+UQ==',key_name='tempest-keypair-398165375',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:10:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63880132a8984ca2bdfb3e226b65a093',ramdisk_id='',reservation_id='r-uh03mtqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-231270075',owner_user_name='tempest-AttachVolumeNegativeTest-231270075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b65985ef3b8403da48b609e49da19db',uuid=f6615f1d-e572-4f50-994d-b0ac31bc2756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converting VIF {"id": "6decf402-321f-4e3c-a584-45ce097d4c2b", "address": "fa:16:3e:62:b9:a5", "network": {"id": "4abf66e7-b9a2-4698-82ec-5c8b0e40a782", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-791932207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63880132a8984ca2bdfb3e226b65a093", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6decf402-32", "ovs_interfaceid": "6decf402-321f-4e3c-a584-45ce097d4c2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG os_vif [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6decf402-32, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cafa8790-1cf6-4375-8877-c683776e347e) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:50 user nova-compute[74507]: INFO os_vif [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:b9:a5,bridge_name='br-int',has_traffic_filtering=True,id=6decf402-321f-4e3c-a584-45ce097d4c2b,network=Network(4abf66e7-b9a2-4698-82ec-5c8b0e40a782),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6decf402-32')
Oct 25 23:13:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Deleting instance files /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756_del
Oct 25 23:13:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Deletion of /opt/stack/data/nova/instances/f6615f1d-e572-4f50-994d-b0ac31bc2756_del complete
Oct 25 23:13:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:50 user nova-compute[74507]: INFO nova.compute.manager [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 25 23:13:50 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:13:50 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Took 0.69 seconds to deallocate network for instance.
Oct 25 23:13:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:51 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Deleted allocations for instance f6615f1d-e572-4f50-994d-b0ac31bc2756
Oct 25 23:13:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-93974284-c103-49e8-b1af-367ea893dfdd tempest-AttachVolumeNegativeTest-231270075 tempest-AttachVolumeNegativeTest-231270075-project-member] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] Acquiring lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] Lock "f6615f1d-e572-4f50-994d-b0ac31bc2756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] No waiting events found dispatching network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:13:51 user nova-compute[74507]: WARNING nova.compute.manager [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received unexpected event network-vif-plugged-6decf402-321f-4e3c-a584-45ce097d4c2b for instance with vm_state deleted and task_state None.
Oct 25 23:13:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-bf119533-4727-43c7-b3e6-673a5925f319 req-793c787b-87cc-49e3-bb09-e30d1d6132a0 service nova] [instance: f6615f1d-e572-4f50-994d-b0ac31bc2756] Received event network-vif-deleted-6decf402-321f-4e3c-a584-45ce097d4c2b {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:13:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:57 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:13:57 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:13:57 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=24.97875213623047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:13:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-changed-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.compute.manager [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Refreshing instance network info cache due to event network-changed-1666fe49-435e-43c4-8104-636eb351625d. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] Acquiring lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] Acquired lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Refreshing network info cache for port 1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:13:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Ignoring supplied device name: /dev/vdb
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:13:59 user nova-compute[74507]: INFO nova.compute.manager [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Attaching volume 01605505-7f97-4efe-851c-eaf833d61cf9 to /dev/vdb
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a05567-9237-407b-afa1-47b705bde697]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce80e6-6472-4208-8950-65dd3f819e11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72972e5f-c73b-4f89-b6fa-6821808bdffc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ace307-f827-4b2b-a2c3-e7b7885525be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:13:59 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ed8747-0f71-487c-897c-3d83b63dad9d]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG os_brick.utils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating existing volume attachment record: d9bd1f2e-7930-4ee6-8881-01c72f9e31af {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updated VIF entry in instance network info cache for port 1666fe49-435e-43c4-8104-636eb351625d. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG nova.network.neutron [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating instance_info_cache with network_info: [{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:13:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b8773103-321d-4721-bba2-8633a2957950 req-113020c1-d8c7-46f8-8ffa-4775aa71ba43 service nova] Releasing lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:14:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:14:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing instance network info cache due to event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] Acquiring lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] Acquired lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG nova.network.neutron [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG nova.network.neutron [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updated VIF entry in instance network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG nova.network.neutron [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-111c62c2-04fb-4d5d-8559-2ef3017e3420 req-631240bb-9102-445b-a523-c8871ec72c2b service nova] Releasing lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:10 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:14:14 user nova-compute[74507]: INFO nova.compute.claims [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Claim successful on node user
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:14:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.policy [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '296b63e942ff4708941cc09ab8feb39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d19559e778f4a25b2764ae9a1d820a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:14:15 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Creating image(s)
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "/opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "/opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "/opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.215s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Successfully created port: c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk 1073741824" returned: 0 in 0.060s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:14:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Cannot resize image /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Successfully updated port: c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquired lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received event network-changed-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Refreshing instance network info cache due to event network-changed-c4d5cf85-f57e-42c9-b508-b0ef6f56d788. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] Acquiring lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Updating instance_info_cache with network_info: [{"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Releasing lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Instance network_info: |[{"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] Acquired lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Refreshing network info cache for port c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Start _get_guest_xml network_info=[{"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:14:16 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:16 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1543448589',display_name='tempest-ServersNegativeTestJSON-server-1543448589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1543448589',id=44,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-ecbqgtp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:14:15Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=db6c31ee-4c9b-4559-a9f8-6ba061db5ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lazy-loading 'pci_devices' on Instance uuid db6c31ee-4c9b-4559-a9f8-6ba061db5ce7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:14:16 user nova-compute[74507]:   <uuid>db6c31ee-4c9b-4559-a9f8-6ba061db5ce7</uuid>
Oct 25 23:14:16 user nova-compute[74507]:   <name>instance-0000002c</name>
Oct 25 23:14:16 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:14:16 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:14:16 user nova-compute[74507]:   <metadata>
Oct 25 23:14:16 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:14:16 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:name>tempest-ServersNegativeTestJSON-server-1543448589</nova:name>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:14:16</nova:creationTime>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:14:16 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:14:16 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:owner>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:user uuid="296b63e942ff4708941cc09ab8feb39a">tempest-ServersNegativeTestJSON-343182396-project-member</nova:user>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:project uuid="8d19559e778f4a25b2764ae9a1d820a1">tempest-ServersNegativeTestJSON-343182396</nova:project>
Oct 25 23:14:16 user nova-compute[74507]:       </nova:owner>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:14:16 user nova-compute[74507]:       <nova:ports>
Oct 25 23:14:16 user nova-compute[74507]:         <nova:port uuid="c4d5cf85-f57e-42c9-b508-b0ef6f56d788">
Oct 25 23:14:16 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 23:14:16 user nova-compute[74507]:         </nova:port>
Oct 25 23:14:16 user nova-compute[74507]:       </nova:ports>
Oct 25 23:14:16 user nova-compute[74507]:     </nova:instance>
Oct 25 23:14:16 user nova-compute[74507]:   </metadata>
Oct 25 23:14:16 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:14:16 user nova-compute[74507]:     <system>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="serial">db6c31ee-4c9b-4559-a9f8-6ba061db5ce7</entry>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="uuid">db6c31ee-4c9b-4559-a9f8-6ba061db5ce7</entry>
Oct 25 23:14:16 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:14:16 user nova-compute[74507]:     </system>
Oct 25 23:14:16 user nova-compute[74507]:   </sysinfo>
Oct 25 23:14:16 user nova-compute[74507]:   <os>
Oct 25 23:14:16 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:14:16 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:14:16 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:14:16 user nova-compute[74507]:   </os>
Oct 25 23:14:16 user nova-compute[74507]:   <features>
Oct 25 23:14:16 user nova-compute[74507]:     <acpi/>
Oct 25 23:14:16 user nova-compute[74507]:     <apic/>
Oct 25 23:14:16 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:14:16 user nova-compute[74507]:   </features>
Oct 25 23:14:16 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:14:16 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:14:16 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:14:16 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:14:16 user nova-compute[74507]:   </clock>
Oct 25 23:14:16 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:14:16 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:14:16 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:14:16 user nova-compute[74507]:   </cpu>
Oct 25 23:14:16 user nova-compute[74507]:   <devices>
Oct 25 23:14:16 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:14:16 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:14:16 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk"/>
Oct 25 23:14:16 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:14:16 user nova-compute[74507]:     </disk>
Oct 25 23:14:16 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:14:16 user nova-compute[74507]:       <mac address="fa:16:3e:96:6a:8e"/>
Oct 25 23:14:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:14:16 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:14:16 user nova-compute[74507]:       <target dev="tapc4d5cf85-f5"/>
Oct 25 23:14:16 user nova-compute[74507]:     </interface>
Oct 25 23:14:16 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:14:16 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/console.log" append="off"/>
Oct 25 23:14:16 user nova-compute[74507]:     </serial>
Oct 25 23:14:16 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:14:16 user nova-compute[74507]:     <video>
Oct 25 23:14:16 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:14:16 user nova-compute[74507]:     </video>
Oct 25 23:14:16 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:14:16 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:14:16 user nova-compute[74507]:     </rng>
Oct 25 23:14:16 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:14:16 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:14:16 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:14:16 user nova-compute[74507]:     </memballoon>
Oct 25 23:14:16 user nova-compute[74507]:   </devices>
Oct 25 23:14:16 user nova-compute[74507]: </domain>
Oct 25 23:14:16 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1543448589',display_name='tempest-ServersNegativeTestJSON-server-1543448589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1543448589',id=44,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-ecbqgtp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:14:15Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=db6c31ee-4c9b-4559-a9f8-6ba061db5ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG os_vif [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30483ba2-3a1a-520d-b618-125da0b6b33f', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4d5cf85-f5, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4d5cf85-f5, col_values=(('qos', UUID('89737de0-17e9-4e5c-a1ad-c048875c8d97')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4d5cf85-f5, col_values=(('external_ids', {'iface-id': 'c4d5cf85-f57e-42c9-b508-b0ef6f56d788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:6a:8e', 'vm-uuid': 'db6c31ee-4c9b-4559-a9f8-6ba061db5ce7'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:16 user nova-compute[74507]: INFO os_vif [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5')
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:14:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] No VIF found with MAC fa:16:3e:96:6a:8e, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Updated VIF entry in instance network info cache for port c4d5cf85-f57e-42c9-b508-b0ef6f56d788. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Updating instance_info_cache with network_info: [{"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b699fcb4-64e9-4bac-9a35-f13fdabff850 req-30c9284d-a5b0-4fe6-b3e5-3d0b03b2d8fc service nova] Releasing lock "refresh_cache-db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjocHmGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:14:17 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:14:17 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:14:17 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac5a04-a544-4b61-9cb6-5f2a40a56e48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:14:17 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c1ad3-4eca-4fe2-be20-908a4efcf0ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9] added
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e2994e-64ea-422d-8226-ce1f53987e2c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f946b137-b9d9-400f-a236-316b41e48ec0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjocHmGR {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjocHmGR" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7e2fa-6e2d-47bd-9c31-b579f977cb9c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjocHmGR'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e61168-f253-4018-b4b9-fb9274f7ac64]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2acebb-ee79-41aa-8ccb-5baee6910e7e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e481183-c8a7-4eb4-9340-89edfcc896fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260]
Oct 25 23:14:17 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260] successful.
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb17cc3-4bc0-4330-b0ad-e25158e135f3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e274d5-ccf4-43ce-a9d2-5fc8986ffb62]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:17 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:17 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:17 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760d495-f1e2-434b-93e8-41beb6b7c41f]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:14:17 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjocHmGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received event network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] Acquiring lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] No waiting events found dispatching network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:14:18 user nova-compute[74507]: WARNING nova.compute.manager [req-b0dcf1f5-0fed-43aa-982a-5b8083c13fda req-e2f40532-5830-4464-a193-09072a370af1 service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received unexpected event network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 for instance with vm_state building and task_state spawning.
Oct 25 23:14:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23638393536323232', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638393536323232', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:14:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:14:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:14:19 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:14:19 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:14:19 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:14:19 user nova-compute[74507]:   <serial>01605505-7f97-4efe-851c-eaf833d61cf9</serial>
Oct 25 23:14:19 user nova-compute[74507]: </disk>
Oct 25 23:14:19 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:14:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:14:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:14:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No VIF found with MAC fa:16:3e:fc:81:14, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:14:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-03e6940e-dd38-4b16-82a4-8c16575f5662 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.892s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:14:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Instance spawned successfully.
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:20 user nova-compute[74507]: INFO nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Took 4.97 seconds to spawn the instance on the hypervisor.
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:14:20 user nova-compute[74507]: INFO nova.compute.manager [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Took 5.59 seconds to build instance.
Oct 25 23:14:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-2a3d33c5-116e-4ac4-b72b-5666d17ea05b tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.691s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received event network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] Acquiring lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] No waiting events found dispatching network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:14:20 user nova-compute[74507]: WARNING nova.compute.manager [req-39d75e57-c2b6-45f5-bbd8-ef34537fee0e req-6e5e23d0-ae14-4cd1-a189-0303f62ff11c service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received unexpected event network-vif-plugged-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 for instance with vm_state active and task_state None.
Oct 25 23:14:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:14:24 user nova-compute[74507]: INFO nova.compute.claims [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Claim successful on node user
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:14:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:14:24 user nova-compute[74507]: INFO nova.virt.block_device [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Booting with volume b216c1c4-11d6-4051-9be3-81edf77f44e5 at /dev/vda
Oct 25 23:14:24 user nova-compute[74507]: DEBUG nova.policy [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da789238dc2446ff9eabe9c9ecc5a1d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3871b32ffb3648b3b8101a0674f89bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG os_brick.utils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a3f717-7aee-4889-8963-ffdc7be10a6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bc2cf-9062-48d3-8a04-a0021f021dcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:24 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192f286-01b4-47e1-96eb-8708ebe4e730]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef991d-c794-4ebd-baf6-e0b9b696a5dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:14:25 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:14:25 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[802671ad-c12a-4959-8c35-10504cc407e2]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG os_brick.utils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:14:25 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating existing volume attachment record: 6095b9f8-7528-40dd-88be-ccdf6447f94e {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Successfully created port: 0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Successfully updated port: 0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquired lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing instance network info cache due to event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] Acquiring lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:14:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG nova.network.neutron [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating instance_info_cache with network_info: [{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Releasing lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Instance network_info: |[{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] Acquired lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updated VIF entry in instance network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG nova.network.neutron [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating instance_info_cache with network_info: [{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-07ee9275-250e-4d3e-9fbc-242b2261e25e req-c0280ec5-a12e-4895-b316-25574a7e9077 service nova] Releasing lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:31 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:14:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Creating image(s)
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Did not create local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Ensure instance console log exists: /opt/stack/data/nova/instances/0e250b18-6025-4524-9d39-2ec19897935a/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Start _get_guest_xml network_info=[{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6095b9f8-7528-40dd-88be-ccdf6447f94e', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYwoRUSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e250b18-6025-4524-9d39-2ec19897935a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b216c1c4-11d6-4051-9be3-81edf77f44e5', 'serial': 'b216c1c4-11d6-4051-9be3-81edf77f44e5'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:14:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:43 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYwoRUSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:14:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:14:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:14:43 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c6e6be-ef32-4ab5-aa12-d7b9fa6a2a5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:14:43 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a10757-cc20-4d6b-86a4-894e33f53e16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5] added
Oct 25 23:14:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5bcc7-2ba0-47a5-9b1d-44dbc162268d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097f977-d5e9-4f2a-b215-65f44a14ca38]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYwoRUSW {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYwoRUSW" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a1ab82-f9b8-4150-9c2c-02e9abecf8fb]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rYwoRUSW'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed6b77-2e7c-42c5-a279-6482b6f4cb33]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0de2a1-7a19-40a8-9482-858236da6a4f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:43 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:43 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b78978-bc2f-4feb-b70d-38c61ba16b14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260]
Oct 25 23:14:43 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260] successful.
Oct 25 23:14:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f53257-1802-4bdd-b23b-48cd3ccfcb33]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080644d-0216-43be-9b94-6c363905c224]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:44 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:44 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:14:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:14:44 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:14:44 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:14:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3157c44-104f-4f55-9170-830870746051]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:14:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYwoRUSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26539373031363231', 'path': '/dev/sdd'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539373031363231', 'path': '/dev/sdd'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382520109',display_name='tempest-TestVolumeBootPattern-server-1382520109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382520109',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-dmfacfmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:14:25Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=0e250b18-6025-4524-9d39-2ec19897935a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e250b18-6025-4524-9d39-2ec19897935a {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:14:45 user nova-compute[74507]:   <uuid>0e250b18-6025-4524-9d39-2ec19897935a</uuid>
Oct 25 23:14:45 user nova-compute[74507]:   <name>instance-0000002d</name>
Oct 25 23:14:45 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:14:45 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:14:45 user nova-compute[74507]:   <metadata>
Oct 25 23:14:45 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:14:45 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:14:45 user nova-compute[74507]:       <nova:name>tempest-TestVolumeBootPattern-server-1382520109</nova:name>
Oct 25 23:14:45 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:14:43</nova:creationTime>
Oct 25 23:14:45 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:14:45 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:14:45 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:14:45 user nova-compute[74507]:       <nova:owner>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:user uuid="da789238dc2446ff9eabe9c9ecc5a1d7">tempest-TestVolumeBootPattern-1389668605-project-member</nova:user>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:project uuid="3871b32ffb3648b3b8101a0674f89bd4">tempest-TestVolumeBootPattern-1389668605</nova:project>
Oct 25 23:14:45 user nova-compute[74507]:       </nova:owner>
Oct 25 23:14:45 user nova-compute[74507]:       <nova:ports>
Oct 25 23:14:45 user nova-compute[74507]:         <nova:port uuid="0da2634a-3103-4005-80b4-8223c41f2cb2">
Oct 25 23:14:45 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 23:14:45 user nova-compute[74507]:         </nova:port>
Oct 25 23:14:45 user nova-compute[74507]:       </nova:ports>
Oct 25 23:14:45 user nova-compute[74507]:     </nova:instance>
Oct 25 23:14:45 user nova-compute[74507]:   </metadata>
Oct 25 23:14:45 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:14:45 user nova-compute[74507]:     <system>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="serial">0e250b18-6025-4524-9d39-2ec19897935a</entry>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="uuid">0e250b18-6025-4524-9d39-2ec19897935a</entry>
Oct 25 23:14:45 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:14:45 user nova-compute[74507]:     </system>
Oct 25 23:14:45 user nova-compute[74507]:   </sysinfo>
Oct 25 23:14:45 user nova-compute[74507]:   <os>
Oct 25 23:14:45 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:14:45 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:14:45 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:14:45 user nova-compute[74507]:   </os>
Oct 25 23:14:45 user nova-compute[74507]:   <features>
Oct 25 23:14:45 user nova-compute[74507]:     <acpi/>
Oct 25 23:14:45 user nova-compute[74507]:     <apic/>
Oct 25 23:14:45 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:14:45 user nova-compute[74507]:   </features>
Oct 25 23:14:45 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:14:45 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:14:45 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:14:45 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:14:45 user nova-compute[74507]:   </clock>
Oct 25 23:14:45 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:14:45 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:14:45 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:14:45 user nova-compute[74507]:   </cpu>
Oct 25 23:14:45 user nova-compute[74507]:   <devices>
Oct 25 23:14:45 user nova-compute[74507]:     <disk type="block" device="disk">
Oct 25 23:14:45 user nova-compute[74507]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:14:45 user nova-compute[74507]:       <source dev="/dev/sdd"/>
Oct 25 23:14:45 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:14:45 user nova-compute[74507]:       <serial>b216c1c4-11d6-4051-9be3-81edf77f44e5</serial>
Oct 25 23:14:45 user nova-compute[74507]:     </disk>
Oct 25 23:14:45 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:14:45 user nova-compute[74507]:       <mac address="fa:16:3e:0e:14:b6"/>
Oct 25 23:14:45 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:14:45 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:14:45 user nova-compute[74507]:       <target dev="tap0da2634a-31"/>
Oct 25 23:14:45 user nova-compute[74507]:     </interface>
Oct 25 23:14:45 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:14:45 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/0e250b18-6025-4524-9d39-2ec19897935a/console.log" append="off"/>
Oct 25 23:14:45 user nova-compute[74507]:     </serial>
Oct 25 23:14:45 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:14:45 user nova-compute[74507]:     <video>
Oct 25 23:14:45 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:14:45 user nova-compute[74507]:     </video>
Oct 25 23:14:45 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:14:45 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:14:45 user nova-compute[74507]:     </rng>
Oct 25 23:14:45 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:14:45 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:14:45 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:14:45 user nova-compute[74507]:     </memballoon>
Oct 25 23:14:45 user nova-compute[74507]:   </devices>
Oct 25 23:14:45 user nova-compute[74507]: </domain>
Oct 25 23:14:45 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382520109',display_name='tempest-TestVolumeBootPattern-server-1382520109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382520109',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-dmfacfmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:14:25Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=0e250b18-6025-4524-9d39-2ec19897935a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG os_vif [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e1fd046-198d-5412-a88e-078e05953ff3', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0da2634a-31, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0da2634a-31, col_values=(('qos', UUID('8b534b2f-215e-462c-ac27-cbe60c039f3e')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0da2634a-31, col_values=(('external_ids', {'iface-id': '0da2634a-3103-4005-80b4-8223c41f2cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:14:b6', 'vm-uuid': '0e250b18-6025-4524-9d39-2ec19897935a'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:45 user nova-compute[74507]: INFO os_vif [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31')
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:14:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] No VIF found with MAC fa:16:3e:0e:14:b6, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:46 user nova-compute[74507]: DEBUG nova.compute.manager [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] No waiting events found dispatching network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:14:46 user nova-compute[74507]: WARNING nova.compute.manager [req-4218881d-69d8-4ab6-b819-cef18155b056 req-b329b366-93de-4202-8a5a-dada90154aa6 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received unexpected event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 for instance with vm_state building and task_state spawning.
Oct 25 23:14:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:47 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:14:48 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Instance spawned successfully.
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:48 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] No waiting events found dispatching network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:14:49 user nova-compute[74507]: WARNING nova.compute.manager [req-cee14691-856a-493e-8a6d-c737c8228111 req-02b363bb-1547-4255-9916-492d17838618 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received unexpected event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 for instance with vm_state building and task_state spawning.
Oct 25 23:14:49 user nova-compute[74507]: INFO nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 25 23:14:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:14:49 user nova-compute[74507]: INFO nova.compute.manager [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Took 24.86 seconds to build instance.
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-c3b484ff-5664-4d60-a0a6-5c1c8a60502f tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.009s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:14:49 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:14:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating instance_info_cache with network_info: [{"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:14:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-9acdaa56-8aa3-49ba-85d5-f728bdff2215" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:14:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:14:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:14:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:14:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:14:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:58 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=24.938804626464844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance db6c31ee-4c9b-4559-a9f8-6ba061db5ce7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 0e250b18-6025-4524-9d39-2ec19897935a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:14:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:15:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:23 user nova-compute[74507]: INFO nova.compute.manager [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Detaching volume 01605505-7f97-4efe-851c-eaf833d61cf9
Oct 25 23:15:23 user nova-compute[74507]: INFO nova.virt.block_device [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Attempting to driver detach volume 01605505-7f97-4efe-851c-eaf833d61cf9 from mountpoint /dev/vdb
Oct 25 23:15:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Attempting to detach device vdb from instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:15:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:15:23 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:15:23 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:15:23 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:15:23 user nova-compute[74507]:   <serial>01605505-7f97-4efe-851c-eaf833d61cf9</serial>
Oct 25 23:15:23 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:15:23 user nova-compute[74507]: </disk>
Oct 25 23:15:23 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:15:23 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully detached device vdb from instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 from the persistent domain config.
Oct 25 23:15:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:15:23 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:15:23 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:15:23 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:15:23 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:15:23 user nova-compute[74507]:   <serial>01605505-7f97-4efe-851c-eaf833d61cf9</serial>
Oct 25 23:15:23 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:15:23 user nova-compute[74507]: </disk>
Oct 25 23:15:23 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:15:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:15:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:26 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:15:33 user nova-compute[74507]: INFO nova.compute.claims [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Claim successful on node user
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:15:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.policy [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8bb37911dc54f07887a658d73bea2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51395d2b88b54d9b94b5861aac4c0b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:15:33 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Creating image(s)
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "/opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "/opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "/opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:33 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.194s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk 1073741824" returned: 0 in 0.060s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Successfully created port: c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Cannot resize image /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Ensure instance console log exists: /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:34 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Successfully updated port: c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquired lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-changed-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.compute.manager [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Refreshing instance network info cache due to event network-changed-c2a5bb71-5951-4e40-84c3-c58a77fe47d0. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] Acquiring lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Updating instance_info_cache with network_info: [{"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Releasing lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Instance network_info: |[{"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] Acquired lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Refreshing network info cache for port c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Start _get_guest_xml network_info=[{"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:15:35 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:15:35 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-855183388',display_name='tempest-VolumesActionsTest-instance-855183388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-855183388',id=46,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-zr1xc3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:15:34Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=06a4252c-d4b1-4407-9107-5aae2ccee43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.objects.instance [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lazy-loading 'pci_devices' on Instance uuid 06a4252c-d4b1-4407-9107-5aae2ccee43b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:15:35 user nova-compute[74507]:   <uuid>06a4252c-d4b1-4407-9107-5aae2ccee43b</uuid>
Oct 25 23:15:35 user nova-compute[74507]:   <name>instance-0000002e</name>
Oct 25 23:15:35 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:15:35 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:15:35 user nova-compute[74507]:   <metadata>
Oct 25 23:15:35 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:15:35 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:name>tempest-VolumesActionsTest-instance-855183388</nova:name>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:15:35</nova:creationTime>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:15:35 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:15:35 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:owner>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:user uuid="a8bb37911dc54f07887a658d73bea2df">tempest-VolumesActionsTest-429168548-project-member</nova:user>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:project uuid="51395d2b88b54d9b94b5861aac4c0b03">tempest-VolumesActionsTest-429168548</nova:project>
Oct 25 23:15:35 user nova-compute[74507]:       </nova:owner>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:15:35 user nova-compute[74507]:       <nova:ports>
Oct 25 23:15:35 user nova-compute[74507]:         <nova:port uuid="c2a5bb71-5951-4e40-84c3-c58a77fe47d0">
Oct 25 23:15:35 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 23:15:35 user nova-compute[74507]:         </nova:port>
Oct 25 23:15:35 user nova-compute[74507]:       </nova:ports>
Oct 25 23:15:35 user nova-compute[74507]:     </nova:instance>
Oct 25 23:15:35 user nova-compute[74507]:   </metadata>
Oct 25 23:15:35 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:15:35 user nova-compute[74507]:     <system>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="serial">06a4252c-d4b1-4407-9107-5aae2ccee43b</entry>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="uuid">06a4252c-d4b1-4407-9107-5aae2ccee43b</entry>
Oct 25 23:15:35 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:15:35 user nova-compute[74507]:     </system>
Oct 25 23:15:35 user nova-compute[74507]:   </sysinfo>
Oct 25 23:15:35 user nova-compute[74507]:   <os>
Oct 25 23:15:35 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:15:35 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:15:35 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:15:35 user nova-compute[74507]:   </os>
Oct 25 23:15:35 user nova-compute[74507]:   <features>
Oct 25 23:15:35 user nova-compute[74507]:     <acpi/>
Oct 25 23:15:35 user nova-compute[74507]:     <apic/>
Oct 25 23:15:35 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:15:35 user nova-compute[74507]:   </features>
Oct 25 23:15:35 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:15:35 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:15:35 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:15:35 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:15:35 user nova-compute[74507]:   </clock>
Oct 25 23:15:35 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:15:35 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:15:35 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:15:35 user nova-compute[74507]:   </cpu>
Oct 25 23:15:35 user nova-compute[74507]:   <devices>
Oct 25 23:15:35 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:15:35 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:15:35 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk"/>
Oct 25 23:15:35 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:15:35 user nova-compute[74507]:     </disk>
Oct 25 23:15:35 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:15:35 user nova-compute[74507]:       <mac address="fa:16:3e:7b:65:3d"/>
Oct 25 23:15:35 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:15:35 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:15:35 user nova-compute[74507]:       <target dev="tapc2a5bb71-59"/>
Oct 25 23:15:35 user nova-compute[74507]:     </interface>
Oct 25 23:15:35 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:15:35 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/console.log" append="off"/>
Oct 25 23:15:35 user nova-compute[74507]:     </serial>
Oct 25 23:15:35 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:15:35 user nova-compute[74507]:     <video>
Oct 25 23:15:35 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:15:35 user nova-compute[74507]:     </video>
Oct 25 23:15:35 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:15:35 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:15:35 user nova-compute[74507]:     </rng>
Oct 25 23:15:35 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:15:35 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:15:35 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:15:35 user nova-compute[74507]:     </memballoon>
Oct 25 23:15:35 user nova-compute[74507]:   </devices>
Oct 25 23:15:35 user nova-compute[74507]: </domain>
Oct 25 23:15:35 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-855183388',display_name='tempest-VolumesActionsTest-instance-855183388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-855183388',id=46,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-zr1xc3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:15:34Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=06a4252c-d4b1-4407-9107-5aae2ccee43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG os_vif [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec6d7720-be5b-54a5-90e1-ee30e65f0358', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a5bb71-59, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a5bb71-59, col_values=(('qos', UUID('309b9ff1-61df-4a24-a506-291eb1c3c29a')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a5bb71-59, col_values=(('external_ids', {'iface-id': 'c2a5bb71-5951-4e40-84c3-c58a77fe47d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:65:3d', 'vm-uuid': '06a4252c-d4b1-4407-9107-5aae2ccee43b'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:35 user nova-compute[74507]: INFO os_vif [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59')
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] No VIF found with MAC fa:16:3e:7b:65:3d, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Updated VIF entry in instance network info cache for port c2a5bb71-5951-4e40-84c3-c58a77fe47d0. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG nova.network.neutron [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Updating instance_info_cache with network_info: [{"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:15:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-5ad46087-f999-464a-b1fd-6f4e9ba26ebb req-f01b9205-a434-48a7-8e4f-fbdfb817a931 service nova] Releasing lock "refresh_cache-06a4252c-d4b1-4407-9107-5aae2ccee43b" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG nova.compute.manager [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] No waiting events found dispatching network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:15:37 user nova-compute[74507]: WARNING nova.compute.manager [req-c8a2813a-f0d9-45bb-9957-d5fdface4d92 req-a9e4b258-6efb-43f9-9db1-fc5d83e0987e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received unexpected event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 for instance with vm_state building and task_state spawning.
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:15:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Instance spawned successfully.
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:15:39 user nova-compute[74507]: INFO nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:15:39 user nova-compute[74507]: INFO nova.compute.manager [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Took 5.98 seconds to build instance.
Oct 25 23:15:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-cd886a62-5a53-441f-b8b2-c91a405231b2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.077s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:39 user nova-compute[74507]: DEBUG nova.compute.manager [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] No waiting events found dispatching network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:15:39 user nova-compute[74507]: WARNING nova.compute.manager [req-765aa50d-8b31-4e74-bacc-029712ef5483 req-7be62301-203e-4e59-97de-7a0b9bdf8372 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received unexpected event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 for instance with vm_state active and task_state None.
Oct 25 23:15:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:44 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 is timed out.
Oct 25 23:15:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully detached device vdb from instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215 from the live domain config.
Oct 25 23:15:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjocHmGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:15:44 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5dd01-7a81-4659-878f-2786e16c8e93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:15:44 user nova-compute[74507]: No targets found.
Oct 25 23:15:44 user nova-compute[74507]: iSNS:
Oct 25 23:15:44 user nova-compute[74507]: No targets found.
Oct 25 23:15:44 user nova-compute[74507]: STATIC:
Oct 25 23:15:44 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9
Oct 25 23:15:44 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:15:44 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:15:44 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5
Oct 25 23:15:44 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:15:44 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:15:44 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:15:44 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:15:44 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:15:44 user nova-compute[74507]: FIRMWARE:
Oct 25 23:15:44 user nova-compute[74507]: No targets found.
Oct 25 23:15:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:15:44 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:15:44 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c646c2c-fe40-4f0d-bd7b-5b31244d3da1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff3675-e3af-42e7-84ea-a37c2691613c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:15:44 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:15:44 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:15:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:15:44 user nova-compute[74507]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 (non-flash)
Oct 25 23:15:44 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:15:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5467aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8294fa2d-7783-4ee6-844a-7e86bfaeca63]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6675ff-29e7-4162-8076-f481ef2893fc]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e890c9-536d-4988-8e0e-3ea7d14afbf1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb5c64-a428-4c65-addd-e7ad4e075004]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc645f5-fdc6-4fb8-b6e7-ea7ed2a83e0a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af4744-6571-4e55-a04e-4ca9d98a44b0]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260]
Oct 25 23:15:44 user nova-compute[74507]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9, portal: 172.16.0.220,3260] successful.
Oct 25 23:15:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f27f0-4b44-4e6a-993f-b636e0bf59fa]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== disconnect_volume: return (324ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:15:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-17c88d96-28c7-46de-a3cc-0411fb076c56 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.755s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:45 user nova-compute[74507]: INFO nova.compute.manager [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Terminating instance
Oct 25 23:15:45 user nova-compute[74507]: DEBUG nova.compute.manager [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-unplugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] No waiting events found dispatching network-vif-unplugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:15:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-d0cc6442-1950-442d-81d6-21d88aad91cd req-080b3628-877e-4a90-9cb3-dd08dc9381f7 service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-unplugged-1666fe49-435e-43c4-8104-636eb351625d for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:15:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Instance destroyed successfully.
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.objects.instance [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'resources' on Instance uuid 9acdaa56-8aa3-49ba-85d5-f728bdff2215 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1841330472',display_name='tempest-VolumesSnapshotTestJSON-instance-1841330472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1841330472',id=41,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP2WyFfGPFqtSRO0CCstd6iAR9f/yfmrBv3BweZXtl93PzyfCO0w5timmXsgvGmYpoDnf/zymf8ScLGiYktFRxsVn4xYl/ITooR3JcmHrVMIj2IJgDPA9ggtkkdS1tfsg==',key_name='tempest-keypair-251123368',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-hlywayco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=9acdaa56-8aa3-49ba-85d5-f728bdff2215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "1666fe49-435e-43c4-8104-636eb351625d", "address": "fa:16:3e:fc:81:14", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1666fe49-43", "ovs_interfaceid": "1666fe49-435e-43c4-8104-636eb351625d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_vif [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1666fe49-43, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eb1320b-2703-4285-bacb-b9eeb54890cb) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:15:46 user nova-compute[74507]: INFO os_vif [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:81:14,bridge_name='br-int',has_traffic_filtering=True,id=1666fe49-435e-43c4-8104-636eb351625d,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1666fe49-43')
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjocHmGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:15:46 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db941e2a-b197-49fb-8e62-732697735598]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:15:46 user nova-compute[74507]: No targets found.
Oct 25 23:15:46 user nova-compute[74507]: iSNS:
Oct 25 23:15:46 user nova-compute[74507]: No targets found.
Oct 25 23:15:46 user nova-compute[74507]: STATIC:
Oct 25 23:15:46 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5
Oct 25 23:15:46 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:15:46 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:15:46 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:15:46 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:15:46 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:15:46 user nova-compute[74507]: FIRMWARE:
Oct 25 23:15:46 user nova-compute[74507]: No targets found.
Oct 25 23:15:46 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:15:46 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:15:46 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01605505-7f97-4efe-851c-eaf833d61cf9', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[598696aa-ad4e-483e-a714-9cfda26f8464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcea565-5541-4aae-8698-d8492522456c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:15:46 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:15:46 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:15:46 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:15:46 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b5435f1c0>, {}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Disconnecting from: [] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== disconnect_volume: return (72ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:15:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Deleting instance files /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215_del
Oct 25 23:15:46 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Deletion of /opt/stack/data/nova/instances/9acdaa56-8aa3-49ba-85d5-f728bdff2215_del complete
Oct 25 23:15:46 user nova-compute[74507]: INFO nova.compute.manager [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 25 23:15:46 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:15:46 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:15:47 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Took 0.75 seconds to deallocate network for instance.
Oct 25 23:15:47 user nova-compute[74507]: WARNING nova.volume.cinder [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Attachment d9bd1f2e-7930-4ee6-8881-01c72f9e31af does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d9bd1f2e-7930-4ee6-8881-01c72f9e31af. (HTTP 404) (Request-ID: req-56d7be38-b411-431c-8118-6a4571d5851f)
Oct 25 23:15:47 user nova-compute[74507]: INFO nova.compute.manager [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Took 0.04 seconds to detach 1 volumes for instance.
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-b3c0a4d7-7e31-479c-bb78-3ec22c0cfc91 req-c087c004-7698-4ed5-b9c1-571605dc6ced service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-deleted-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:47 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Deleted allocations for instance 9acdaa56-8aa3-49ba-85d5-f728bdff2215
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-769f6617-004c-4679-a100-57725942a875 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] Acquiring lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] Lock "9acdaa56-8aa3-49ba-85d5-f728bdff2215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:47 user nova-compute[74507]: DEBUG nova.compute.manager [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] No waiting events found dispatching network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:15:47 user nova-compute[74507]: WARNING nova.compute.manager [req-cf8a9827-f4c7-457e-9e4a-8d2a696ff8a1 req-ba091912-07c5-418c-911e-c5b17b272b4d service nova] [instance: 9acdaa56-8aa3-49ba-85d5-f728bdff2215] Received unexpected event network-vif-plugged-1666fe49-435e-43c4-8104-636eb351625d for instance with vm_state deleted and task_state None.
Oct 25 23:15:49 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:15:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:15:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:15:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:56 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:15:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:15:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:15:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:00 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:16:00 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=24.927474975585938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance db6c31ee-4c9b-4559-a9f8-6ba061db5ce7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 0e250b18-6025-4524-9d39-2ec19897935a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 06a4252c-d4b1-4407-9107-5aae2ccee43b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:16:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:04 user nova-compute[74507]: INFO nova.compute.manager [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Terminating instance
Oct 25 23:16:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Instance destroyed successfully.
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lazy-loading 'resources' on Instance uuid db6c31ee-4c9b-4559-a9f8-6ba061db5ce7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1543448589',display_name='tempest-ServersNegativeTestJSON-server-1543448589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1543448589',id=44,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:14:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-ecbqgtp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:14:20Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=db6c31ee-4c9b-4559-a9f8-6ba061db5ce7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "address": "fa:16:3e:96:6a:8e", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d5cf85-f5", "ovs_interfaceid": "c4d5cf85-f57e-42c9-b508-b0ef6f56d788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG os_vif [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4d5cf85-f5, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89737de0-17e9-4e5c-a1ad-c048875c8d97) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:05 user nova-compute[74507]: INFO os_vif [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:6a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c4d5cf85-f57e-42c9-b508-b0ef6f56d788,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d5cf85-f5')
Oct 25 23:16:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Deleting instance files /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7_del
Oct 25 23:16:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Deletion of /opt/stack/data/nova/instances/db6c31ee-4c9b-4559-a9f8-6ba061db5ce7_del complete
Oct 25 23:16:05 user nova-compute[74507]: INFO nova.compute.manager [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 25 23:16:05 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:05 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Took 0.51 seconds to deallocate network for instance.
Oct 25 23:16:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-8a485d2b-0eef-4aa9-ac4f-3d46c2bfe2e9 req-e6e9f889-f536-4a93-9489-124cdafac5b1 service nova] [instance: db6c31ee-4c9b-4559-a9f8-6ba061db5ce7] Received event network-vif-deleted-c4d5cf85-f57e-42c9-b508-b0ef6f56d788 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:06 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:16:06 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:16:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:06 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Deleted allocations for instance db6c31ee-4c9b-4559-a9f8-6ba061db5ce7
Oct 25 23:16:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0ed4196a-b4ce-424b-bee0-1deef0d9247d tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "db6c31ee-4c9b-4559-a9f8-6ba061db5ce7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.618s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:16:12 user nova-compute[74507]: INFO nova.compute.claims [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Claim successful on node user
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:16:12 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.policy [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c70cb4f053c1476daa7371c12830eece', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4dc320f598644d4987ebe8b3903f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:16:12 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Creating image(s)
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "/opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "/opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "/opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.211s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk 1073741824" returned: 0 in 0.055s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Successfully created port: 10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Cannot resize image /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Ensure instance console log exists: /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Successfully updated port: 10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquired lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-changed-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.compute.manager [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Refreshing instance network info cache due to event network-changed-10e3b647-ff34-4209-b333-afa9a77785b3. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] Acquiring lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.neutron [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Releasing lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Instance network_info: |[{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] Acquired lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.neutron [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Refreshing network info cache for port 10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Start _get_guest_xml network_info=[{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:16:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:16:14 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1528738071',display_name='tempest-TestServerVolumeAttachmentScenario-server-1528738071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1528738071',id=47,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCvcS8JdoPGqnn28IsgcNindz4z8j/NbxgaH3s3eEt3VmzhD8Ulz3L6EpU7WM9TdThRjrHEBciyKdmLa21DJvZktt0jmPZLENTRLW44540QnjZelYSfPxysg7lyuyZGeg==',key_name='tempest-keypair-1675751534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4dc320f598644d4987ebe8b3903f1f1',ramdisk_id='',reservation_id='r-olblby2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-562683234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-562683234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c70cb4f053c1476daa7371c12830eece',uuid=942e159b-ba7a-47ed-9d50-c02e941c3a65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converting VIF {"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'pci_devices' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:16:14 user nova-compute[74507]:   <uuid>942e159b-ba7a-47ed-9d50-c02e941c3a65</uuid>
Oct 25 23:16:14 user nova-compute[74507]:   <name>instance-0000002f</name>
Oct 25 23:16:14 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:16:14 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:16:14 user nova-compute[74507]:   <metadata>
Oct 25 23:16:14 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:16:14 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1528738071</nova:name>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:16:14</nova:creationTime>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:16:14 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:16:14 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:owner>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:user uuid="c70cb4f053c1476daa7371c12830eece">tempest-TestServerVolumeAttachmentScenario-562683234-project-member</nova:user>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:project uuid="e4dc320f598644d4987ebe8b3903f1f1">tempest-TestServerVolumeAttachmentScenario-562683234</nova:project>
Oct 25 23:16:14 user nova-compute[74507]:       </nova:owner>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:16:14 user nova-compute[74507]:       <nova:ports>
Oct 25 23:16:14 user nova-compute[74507]:         <nova:port uuid="10e3b647-ff34-4209-b333-afa9a77785b3">
Oct 25 23:16:14 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 23:16:14 user nova-compute[74507]:         </nova:port>
Oct 25 23:16:14 user nova-compute[74507]:       </nova:ports>
Oct 25 23:16:14 user nova-compute[74507]:     </nova:instance>
Oct 25 23:16:14 user nova-compute[74507]:   </metadata>
Oct 25 23:16:14 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:16:14 user nova-compute[74507]:     <system>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="serial">942e159b-ba7a-47ed-9d50-c02e941c3a65</entry>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="uuid">942e159b-ba7a-47ed-9d50-c02e941c3a65</entry>
Oct 25 23:16:14 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:16:14 user nova-compute[74507]:     </system>
Oct 25 23:16:14 user nova-compute[74507]:   </sysinfo>
Oct 25 23:16:14 user nova-compute[74507]:   <os>
Oct 25 23:16:14 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:16:14 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:16:14 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:16:14 user nova-compute[74507]:   </os>
Oct 25 23:16:14 user nova-compute[74507]:   <features>
Oct 25 23:16:14 user nova-compute[74507]:     <acpi/>
Oct 25 23:16:14 user nova-compute[74507]:     <apic/>
Oct 25 23:16:14 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:16:14 user nova-compute[74507]:   </features>
Oct 25 23:16:14 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:16:14 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:16:14 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:16:14 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:16:14 user nova-compute[74507]:   </clock>
Oct 25 23:16:14 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:16:14 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:16:14 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:16:14 user nova-compute[74507]:   </cpu>
Oct 25 23:16:14 user nova-compute[74507]:   <devices>
Oct 25 23:16:14 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:16:14 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:16:14 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk"/>
Oct 25 23:16:14 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:16:14 user nova-compute[74507]:     </disk>
Oct 25 23:16:14 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:16:14 user nova-compute[74507]:       <mac address="fa:16:3e:e3:ac:07"/>
Oct 25 23:16:14 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:16:14 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:16:14 user nova-compute[74507]:       <target dev="tap10e3b647-ff"/>
Oct 25 23:16:14 user nova-compute[74507]:     </interface>
Oct 25 23:16:14 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:16:14 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/console.log" append="off"/>
Oct 25 23:16:14 user nova-compute[74507]:     </serial>
Oct 25 23:16:14 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:16:14 user nova-compute[74507]:     <video>
Oct 25 23:16:14 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:16:14 user nova-compute[74507]:     </video>
Oct 25 23:16:14 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:16:14 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:16:14 user nova-compute[74507]:     </rng>
Oct 25 23:16:14 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:16:14 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:16:14 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:16:14 user nova-compute[74507]:     </memballoon>
Oct 25 23:16:14 user nova-compute[74507]:   </devices>
Oct 25 23:16:14 user nova-compute[74507]: </domain>
Oct 25 23:16:14 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1528738071',display_name='tempest-TestServerVolumeAttachmentScenario-server-1528738071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1528738071',id=47,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCvcS8JdoPGqnn28IsgcNindz4z8j/NbxgaH3s3eEt3VmzhD8Ulz3L6EpU7WM9TdThRjrHEBciyKdmLa21DJvZktt0jmPZLENTRLW44540QnjZelYSfPxysg7lyuyZGeg==',key_name='tempest-keypair-1675751534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4dc320f598644d4987ebe8b3903f1f1',ramdisk_id='',reservation_id='r-olblby2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-562683234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-562683234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:16:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c70cb4f053c1476daa7371c12830eece',uuid=942e159b-ba7a-47ed-9d50-c02e941c3a65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converting VIF {"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG os_vif [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd23f4c6-abaf-5b2c-acbf-9e54561f563b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e3b647-ff, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10e3b647-ff, col_values=(('qos', UUID('3e62ea97-0701-48f4-9e38-88d57e597847')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10e3b647-ff, col_values=(('external_ids', {'iface-id': '10e3b647-ff34-4209-b333-afa9a77785b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:ac:07', 'vm-uuid': '942e159b-ba7a-47ed-9d50-c02e941c3a65'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:14 user nova-compute[74507]: INFO os_vif [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff')
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:16:14 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No VIF found with MAC fa:16:3e:e3:ac:07, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:16:15 user nova-compute[74507]: DEBUG nova.network.neutron [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updated VIF entry in instance network info cache for port 10e3b647-ff34-4209-b333-afa9a77785b3. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:16:15 user nova-compute[74507]: DEBUG nova.network.neutron [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a9ef2e40-144b-4fb5-87c0-c0edd3813b36 req-5f064dcb-eca8-4143-a584-34b69016c90a service nova] Releasing lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] No waiting events found dispatching network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:16:16 user nova-compute[74507]: WARNING nova.compute.manager [req-a0a5e47e-69e3-4658-a402-7ebdd3fe0664 req-3c2d8809-8ec5-4735-921b-ef205dfda62b service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received unexpected event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 for instance with vm_state building and task_state spawning.
Oct 25 23:16:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG nova.compute.manager [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing instance network info cache due to event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] Acquiring lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] Acquired lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG nova.network.neutron [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updated VIF entry in instance network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating instance_info_cache with network_info: [{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e64e1910-7eb6-4936-a600-b7acc6d465b8 req-40581a05-4b97-4b79-8685-e2b3c4b1f17d service nova] Releasing lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing instance network info cache due to event network-changed-0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] Acquiring lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] Acquired lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Refreshing network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:17 user nova-compute[74507]: INFO nova.compute.manager [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Terminating instance
Oct 25 23:16:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updated VIF entry in instance network info cache for port 0da2634a-3103-4005-80b4-8223c41f2cb2. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating instance_info_cache with network_info: [{"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-7d71a3a7-57cf-428e-8cdc-d91f5330e604 req-70662fb9-a629-4259-bd79-e69f5a11aa1e service nova] Releasing lock "refresh_cache-0e250b18-6025-4524-9d39-2ec19897935a" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] No waiting events found dispatching network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:16:18 user nova-compute[74507]: WARNING nova.compute.manager [req-21c84081-e321-4f3c-a839-ece7133acb79 req-c33b88dd-8cfe-4792-b250-29b475c3367f service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received unexpected event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 for instance with vm_state building and task_state spawning.
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Instance spawned successfully.
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Instance destroyed successfully.
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.objects.instance [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid 0e250b18-6025-4524-9d39-2ec19897935a {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382520109',display_name='tempest-TestVolumeBootPattern-server-1382520109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382520109',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-dmfacfmz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:14:49Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=0e250b18-6025-4524-9d39-2ec19897935a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "0da2634a-3103-4005-80b4-8223c41f2cb2", "address": "fa:16:3e:0e:14:b6", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da2634a-31", "ovs_interfaceid": "0da2634a-3103-4005-80b4-8223c41f2cb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_vif [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0da2634a-31, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b534b2f-215e-462c-ac27-cbe60c039f3e) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:18 user nova-compute[74507]: INFO os_vif [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:b6,bridge_name='br-int',has_traffic_filtering=True,id=0da2634a-3103-4005-80b4-8223c41f2cb2,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da2634a-31')
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYwoRUSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:16:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c6e5d-2557-47cf-b335-f65298cc8ca3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:16:18 user nova-compute[74507]: No targets found.
Oct 25 23:16:18 user nova-compute[74507]: iSNS:
Oct 25 23:16:18 user nova-compute[74507]: No targets found.
Oct 25 23:16:18 user nova-compute[74507]: STATIC:
Oct 25 23:16:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5
Oct 25 23:16:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:16:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:16:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:16:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:16:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:16:18 user nova-compute[74507]: FIRMWARE:
Oct 25 23:16:18 user nova-compute[74507]: No targets found.
Oct 25 23:16:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:16:18 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:16:18 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a28502d-b774-4d90-b233-92615094a4cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfb830a-fcd8-4117-bb95-c4cd9f54d0df]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:16:18 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:16:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:16:18 user nova-compute[74507]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 (non-flash)
Oct 25 23:16:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54474700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5'): ({'sdd'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdd {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a4ba64-7fd8-4f59-9adf-03fef4a89cfe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cbfa12-b431-4588-800f-67eff3c389ff]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.compute.manager [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Took 6.46 seconds to build instance.
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdd {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f03455-344f-467a-9398-3e044ba0cfc1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-efc79c02-0389-4d1e-aff0-a98279fcf932 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.569s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dc75fb-7544-49dd-9972-c939360025f2]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdd have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcd53e5-3b13-4e63-8a47-d3ed8802a186]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465a740-b4c0-436a-8851-6bd1ca139f66]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260]
Oct 25 23:16:18 user nova-compute[74507]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5, portal: 172.16.0.220,3260] successful.
Oct 25 23:16:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b216c1c4-11d6-4051-9be3-81edf77f44e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac6944f-703a-49e1-a458-3be36c9412e2]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (371ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Deleting instance files /opt/stack/data/nova/instances/0e250b18-6025-4524-9d39-2ec19897935a_del
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Deletion of /opt/stack/data/nova/instances/0e250b18-6025-4524-9d39-2ec19897935a_del complete
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-unplugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] No waiting events found dispatching network-vif-unplugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-unplugged-0da2634a-3103-4005-80b4-8223c41f2cb2 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Acquiring lock "0e250b18-6025-4524-9d39-2ec19897935a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] Lock "0e250b18-6025-4524-9d39-2ec19897935a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] No waiting events found dispatching network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:16:18 user nova-compute[74507]: WARNING nova.compute.manager [req-b048eda4-4493-476f-b0e3-d3cd4b0b1b39 req-51637cf9-4ec1-438b-aa17-e29707e9ef41 service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received unexpected event network-vif-plugged-0da2634a-3103-4005-80b4-8223c41f2cb2 for instance with vm_state active and task_state deleting.
Oct 25 23:16:18 user nova-compute[74507]: INFO nova.compute.manager [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 25 23:16:18 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:16:18 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:16:19 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:19 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Took 0.55 seconds to deallocate network for instance.
Oct 25 23:16:20 user nova-compute[74507]: INFO nova.compute.manager [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Took 0.99 seconds to detach 1 volumes for instance.
Oct 25 23:16:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:20 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:16:20 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:16:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:20 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance 0e250b18-6025-4524-9d39-2ec19897935a
Oct 25 23:16:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-06beacd0-19de-483b-ad24-02081da16076 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "0e250b18-6025-4524-9d39-2ec19897935a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.245s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:20 user nova-compute[74507]: DEBUG nova.compute.manager [req-b8c62417-69e0-4c32-b90a-2f18df9a0cce req-95631aa1-088f-4cb1-83ba-6d8dff5b784e service nova] [instance: 0e250b18-6025-4524-9d39-2ec19897935a] Received event network-vif-deleted-0da2634a-3103-4005-80b4-8223c41f2cb2 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:16:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:16:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:50 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:16:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:16:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:16:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:16:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:16:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:16:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:16:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:52 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:58 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:16:59 user nova-compute[74507]: INFO nova.compute.claims [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Claim successful on node user
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:16:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.policy [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d05b04dc684a4db5d1055283fdbd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b9bdeae9415da4bf6c96bb4f7b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:16:59 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Creating image(s)
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "/opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "/opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:16:59 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.418s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:00 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:17:00 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=24.914386749267578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Successfully created port: 5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 06a4252c-d4b1-4407-9107-5aae2ccee43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 98b3f61e-6330-488b-9d85-f91644f98ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk 1073741824" returned: 0 in 0.134s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.205s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:17:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Successfully updated port: 5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Cannot resize image /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-changed-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.compute.manager [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Refreshing instance network info cache due to event network-changed-5a084df5-970e-4ff0-81bf-cf1ae28dba4a. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] Acquiring lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] Acquired lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Refreshing network info cache for port 5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-858e5c70-ccd5-4b90-ac22-1cd43574b75e req-d2d405e7-b24f-4dfe-a65c-d3cc73b025dd service nova] Releasing lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquired lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating instance_info_cache with network_info: [{"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Releasing lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance network_info: |[{"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Start _get_guest_xml network_info=[{"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:17:01 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:17:01 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1892705917',display_name='tempest-VolumesSnapshotTestJSON-instance-1892705917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1892705917',id=48,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIAgA6GB1t3oAl+8X3z/nEl6h06qPDmtOTZWWrC6QgyZHSsn4YuHIb36ni3XJVbQhHgndBsC8P5heAtbxUiEu8syVZGzXsgX0a1JONT9p33tDGvgKubUkl+A0oEhQ+mRg==',key_name='tempest-keypair-1611989880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-4azjqmo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=98b3f61e-6330-488b-9d85-f91644f98ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'pci_devices' on Instance uuid 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:17:01 user nova-compute[74507]:   <uuid>98b3f61e-6330-488b-9d85-f91644f98ba5</uuid>
Oct 25 23:17:01 user nova-compute[74507]:   <name>instance-00000030</name>
Oct 25 23:17:01 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:17:01 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:17:01 user nova-compute[74507]:   <metadata>
Oct 25 23:17:01 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:17:01 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1892705917</nova:name>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:17:01</nova:creationTime>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:17:01 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:17:01 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:owner>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:user uuid="60d05b04dc684a4db5d1055283fdbd74">tempest-VolumesSnapshotTestJSON-1984329490-project-member</nova:user>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:project uuid="1155b9bdeae9415da4bf6c96bb4f7b1c">tempest-VolumesSnapshotTestJSON-1984329490</nova:project>
Oct 25 23:17:01 user nova-compute[74507]:       </nova:owner>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:17:01 user nova-compute[74507]:       <nova:ports>
Oct 25 23:17:01 user nova-compute[74507]:         <nova:port uuid="5a084df5-970e-4ff0-81bf-cf1ae28dba4a">
Oct 25 23:17:01 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 23:17:01 user nova-compute[74507]:         </nova:port>
Oct 25 23:17:01 user nova-compute[74507]:       </nova:ports>
Oct 25 23:17:01 user nova-compute[74507]:     </nova:instance>
Oct 25 23:17:01 user nova-compute[74507]:   </metadata>
Oct 25 23:17:01 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:17:01 user nova-compute[74507]:     <system>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="serial">98b3f61e-6330-488b-9d85-f91644f98ba5</entry>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="uuid">98b3f61e-6330-488b-9d85-f91644f98ba5</entry>
Oct 25 23:17:01 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:17:01 user nova-compute[74507]:     </system>
Oct 25 23:17:01 user nova-compute[74507]:   </sysinfo>
Oct 25 23:17:01 user nova-compute[74507]:   <os>
Oct 25 23:17:01 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:17:01 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:17:01 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:17:01 user nova-compute[74507]:   </os>
Oct 25 23:17:01 user nova-compute[74507]:   <features>
Oct 25 23:17:01 user nova-compute[74507]:     <acpi/>
Oct 25 23:17:01 user nova-compute[74507]:     <apic/>
Oct 25 23:17:01 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:17:01 user nova-compute[74507]:   </features>
Oct 25 23:17:01 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:17:01 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:17:01 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:17:01 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:17:01 user nova-compute[74507]:   </clock>
Oct 25 23:17:01 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:17:01 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:17:01 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:17:01 user nova-compute[74507]:   </cpu>
Oct 25 23:17:01 user nova-compute[74507]:   <devices>
Oct 25 23:17:01 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:17:01 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:17:01 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk"/>
Oct 25 23:17:01 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:17:01 user nova-compute[74507]:     </disk>
Oct 25 23:17:01 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:17:01 user nova-compute[74507]:       <mac address="fa:16:3e:ad:9d:19"/>
Oct 25 23:17:01 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:17:01 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:17:01 user nova-compute[74507]:       <target dev="tap5a084df5-97"/>
Oct 25 23:17:01 user nova-compute[74507]:     </interface>
Oct 25 23:17:01 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:17:01 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/console.log" append="off"/>
Oct 25 23:17:01 user nova-compute[74507]:     </serial>
Oct 25 23:17:01 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:17:01 user nova-compute[74507]:     <video>
Oct 25 23:17:01 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:17:01 user nova-compute[74507]:     </video>
Oct 25 23:17:01 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:17:01 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:17:01 user nova-compute[74507]:     </rng>
Oct 25 23:17:01 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:17:01 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:17:01 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:17:01 user nova-compute[74507]:     </memballoon>
Oct 25 23:17:01 user nova-compute[74507]:   </devices>
Oct 25 23:17:01 user nova-compute[74507]: </domain>
Oct 25 23:17:01 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1892705917',display_name='tempest-VolumesSnapshotTestJSON-instance-1892705917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1892705917',id=48,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIAgA6GB1t3oAl+8X3z/nEl6h06qPDmtOTZWWrC6QgyZHSsn4YuHIb36ni3XJVbQhHgndBsC8P5heAtbxUiEu8syVZGzXsgX0a1JONT9p33tDGvgKubUkl+A0oEhQ+mRg==',key_name='tempest-keypair-1611989880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-4azjqmo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=98b3f61e-6330-488b-9d85-f91644f98ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG os_vif [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdade8b3-8108-5461-bb0f-b7937199f4bb', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a084df5-97, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a084df5-97, col_values=(('qos', UUID('9db13871-036e-4b26-86d5-7354b8770933')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a084df5-97, col_values=(('external_ids', {'iface-id': '5a084df5-970e-4ff0-81bf-cf1ae28dba4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:9d:19', 'vm-uuid': '98b3f61e-6330-488b-9d85-f91644f98ba5'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:01 user nova-compute[74507]: INFO os_vif [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97')
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:17:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No VIF found with MAC fa:16:3e:ad:9d:19, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:17:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] No waiting events found dispatching network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:03 user nova-compute[74507]: WARNING nova.compute.manager [req-418035a2-3ff6-4889-983d-a64241e68cef req-731dc039-b110-475f-ac50-268e5ee11f7a service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received unexpected event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a for instance with vm_state building and task_state spawning.
Oct 25 23:17:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:17:05 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance spawned successfully.
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:17:05 user nova-compute[74507]: INFO nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:17:05 user nova-compute[74507]: INFO nova.compute.manager [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Took 6.28 seconds to build instance.
Oct 25 23:17:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1d2cfca3-8cbb-4986-adf3-6d1e8cce1540 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.413s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:05 user nova-compute[74507]: DEBUG nova.compute.manager [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] No waiting events found dispatching network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:05 user nova-compute[74507]: WARNING nova.compute.manager [req-dc3e2f3c-cc3f-4b45-8238-8d407aedf33c req-40b3783b-bcbe-4697-a26b-62d807717ec7 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received unexpected event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a for instance with vm_state active and task_state None.
Oct 25 23:17:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:17:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:17:11 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:16 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:17:21 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:24 user nova-compute[74507]: INFO nova.compute.manager [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Terminating instance
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.compute.manager [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-unplugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] No waiting events found dispatching network-vif-unplugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.compute.manager [req-d6be91bb-038b-48d2-88af-4adaa714aa62 req-007fc64c-a08e-4daa-9599-738e9e21e406 service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-unplugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Instance destroyed successfully.
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.objects.instance [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lazy-loading 'resources' on Instance uuid 06a4252c-d4b1-4407-9107-5aae2ccee43b {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-855183388',display_name='tempest-VolumesActionsTest-instance-855183388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-855183388',id=46,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-zr1xc3pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:15:39Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=06a4252c-d4b1-4407-9107-5aae2ccee43b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "address": "fa:16:3e:7b:65:3d", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a5bb71-59", "ovs_interfaceid": "c2a5bb71-5951-4e40-84c3-c58a77fe47d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG os_vif [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a5bb71-59, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=309b9ff1-61df-4a24-a506-291eb1c3c29a) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:24 user nova-compute[74507]: INFO os_vif [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:65:3d,bridge_name='br-int',has_traffic_filtering=True,id=c2a5bb71-5951-4e40-84c3-c58a77fe47d0,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a5bb71-59')
Oct 25 23:17:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Deleting instance files /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b_del
Oct 25 23:17:24 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Deletion of /opt/stack/data/nova/instances/06a4252c-d4b1-4407-9107-5aae2ccee43b_del complete
Oct 25 23:17:24 user nova-compute[74507]: INFO nova.compute.manager [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 25 23:17:24 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:17:24 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:17:25 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:25 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Took 0.44 seconds to deallocate network for instance.
Oct 25 23:17:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:25 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:17:25 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:17:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:25 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Deleted allocations for instance 06a4252c-d4b1-4407-9107-5aae2ccee43b
Oct 25 23:17:25 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-73e84b15-c3d1-4240-9213-9ecd85ca7da6 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.506s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] Acquiring lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] Lock "06a4252c-d4b1-4407-9107-5aae2ccee43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] No waiting events found dispatching network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:26 user nova-compute[74507]: WARNING nova.compute.manager [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received unexpected event network-vif-plugged-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 for instance with vm_state deleted and task_state None.
Oct 25 23:17:26 user nova-compute[74507]: DEBUG nova.compute.manager [req-628b9a47-1ae3-46c1-ad9f-e3c3069d9174 req-e2885a7d-c8de-4abf-bf11-78cabb13053e service nova] [instance: 06a4252c-d4b1-4407-9107-5aae2ccee43b] Received event network-vif-deleted-c2a5bb71-5951-4e40-84c3-c58a77fe47d0 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing instance network info cache due to event network-changed-b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] Acquiring lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] Acquired lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Refreshing network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:38 user nova-compute[74507]: INFO nova.compute.manager [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Terminating instance
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-unplugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] No waiting events found dispatching network-vif-unplugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.compute.manager [req-a737ba90-7acd-434b-8aa4-e31c0b811b79 req-189c9a2a-f245-4ec0-ae57-64eb38cc4619 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-unplugged-b972505f-6f8a-43c8-8f84-8658f78f26ed for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updated VIF entry in instance network info cache for port b972505f-6f8a-43c8-8f84-8658f78f26ed. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.network.neutron [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [{"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0838284c-9203-49a2-be78-022c816a395c req-9dfccd79-38d1-4396-9809-5ba5c40510f1 service nova] Releasing lock "refresh_cache-b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:17:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Instance destroyed successfully.
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.objects.instance [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lazy-loading 'resources' on Instance uuid b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-570501046',display_name='tempest-TestVolumeBootPattern-server-570501046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-570501046',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW8JggjQAAUv5T1hiZ5MhWHaE9lP2KVDA8vxcV03jtXWyvUv8L9/6FG7Tj4jUMO2SxijyX04bY8OW96q6XMHGWSw722FBOJ1UNF2R09CWbiPNLT3U0xAnDc4RoMU1tGnQ==',key_name='tempest-TestVolumeBootPattern-12925206',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3871b32ffb3648b3b8101a0674f89bd4',ramdisk_id='',reservation_id='r-7i51u172',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1389668605',owner_user_name='tempest-TestVolumeBootPattern-1389668605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:13:00Z,user_data=None,user_id='da789238dc2446ff9eabe9c9ecc5a1d7',uuid=b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converting VIF {"id": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "address": "fa:16:3e:69:06:7c", "network": {"id": "aa1c1bff-b071-46b2-95f6-1908c3ce5a28", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-721981379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3871b32ffb3648b3b8101a0674f89bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb972505f-6f", "ovs_interfaceid": "b972505f-6f8a-43c8-8f84-8658f78f26ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:17:38 user nova-compute[74507]: DEBUG os_vif [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb972505f-6f, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c05a8bad-49b3-4f77-be9a-74c958307657) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:39 user nova-compute[74507]: INFO os_vif [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:06:7c,bridge_name='br-int',has_traffic_filtering=True,id=b972505f-6f8a-43c8-8f84-8658f78f26ed,network=Network(aa1c1bff-b071-46b2-95f6-1908c3ce5a28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb972505f-6f')
Oct 25 23:17:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZRDhXQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:17:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8567020-8ffe-4945-b83e-776c558308d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:17:39 user nova-compute[74507]: No targets found.
Oct 25 23:17:39 user nova-compute[74507]: iSNS:
Oct 25 23:17:39 user nova-compute[74507]: No targets found.
Oct 25 23:17:39 user nova-compute[74507]: STATIC:
Oct 25 23:17:39 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c
Oct 25 23:17:39 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:17:39 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:17:39 user nova-compute[74507]: FIRMWARE:
Oct 25 23:17:39 user nova-compute[74507]: No targets found.
Oct 25 23:17:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:17:39 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:17:39 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6938febd-cff2-46e0-8c42-b8d79778e04c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc16556b-e954-429c-a496-49b271b35910]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:17:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c (non-flash)
Oct 25 23:17:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b543437f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b0a10-a7ed-4e45-96e4-12db522518fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddaf14f-8f57-4759-b674-c539d79b0ac0]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4aa0e-a165-46de-a5e0-091950ab86b1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b00b9-a0df-46ba-bb81-d1901cc0f8d8]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfeb0bcb9-6712fdeecee99559', '/dev/disk/by-id/scsi-23637313266646565', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_feb0bcb9') {{(pid=86030) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f701d35-8e3f-4fd2-abe9-b79e196fdcd1]: (4, None) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8e5d5-e4a2-430e-8705-87ba090235f8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[83665063-f228-474e-b8e5-836a641b6d1a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260]
Oct 25 23:17:39 user nova-compute[74507]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c, portal: 172.16.0.220,3260] successful.
Oct 25 23:17:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80ee4080-aa50-463e-a045-1a1456aaac0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8fa8e5-f88a-4426-b01c-96c4b0d90836]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] <== disconnect_volume: return (285ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:17:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Deleting instance files /opt/stack/data/nova/instances/b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5_del
Oct 25 23:17:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Deletion of /opt/stack/data/nova/instances/b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5_del complete
Oct 25 23:17:39 user nova-compute[74507]: INFO nova.compute.manager [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 25 23:17:39 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:17:39 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:17:40 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:40 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Took 1.20 seconds to deallocate network for instance.
Oct 25 23:17:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] Acquiring lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] No waiting events found dispatching network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:17:40 user nova-compute[74507]: WARNING nova.compute.manager [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received unexpected event network-vif-plugged-b972505f-6f8a-43c8-8f84-8658f78f26ed for instance with vm_state active and task_state deleting.
Oct 25 23:17:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-ca2b8a8c-773a-4ecd-a9ca-3225e784942d req-ff1fd125-6a36-474c-a00f-5d3f61efe1ed service nova] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Received event network-vif-deleted-b972505f-6f8a-43c8-8f84-8658f78f26ed {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:17:41 user nova-compute[74507]: INFO nova.compute.manager [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] [instance: b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5] Took 0.81 seconds to detach 1 volumes for instance.
Oct 25 23:17:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:17:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:17:41 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:17:41 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:17:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:41 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Deleted allocations for instance b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5
Oct 25 23:17:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-1fd2bad8-fc40-4fb8-aeb2-fb37a8d2ded2 tempest-TestVolumeBootPattern-1389668605 tempest-TestVolumeBootPattern-1389668605-project-member] Lock "b6d8d6d5-502e-44d0-9c2b-c1df1167d2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.546s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:17:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:17:51 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid de575cf3-3998-4ca6-b46d-1ca07ee17ec5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:17:52 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:17:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:17:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:17:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:17:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:17:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:00 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:01 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:02 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:18:02 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8586MB free_disk=24.91208267211914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 98b3f61e-6330-488b-9d85-f91644f98ba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:18:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-changed-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.compute.manager [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Refreshing instance network info cache due to event network-changed-10e3b647-ff34-4209-b333-afa9a77785b3. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] Acquiring lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] Acquired lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Refreshing network info cache for port 10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updated VIF entry in instance network info cache for port 10e3b647-ff34-4209-b333-afa9a77785b3. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.network.neutron [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2e9606c8-8f71-4bb6-9042-e4c2dc30615e req-dac35f74-07ed-4383-ac7d-f2ea0f91837e service nova] Releasing lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:03 user nova-compute[74507]: INFO nova.compute.manager [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attaching volume 3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 to /dev/vdb
Oct 25 23:18:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.utils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c76b36d-a0d1-4a32-b2b1-30dc7d580795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd2612d-ca17-40e4-8083-df54b821e313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f9caa-2c81-44ca-b948-31c93afb5e3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a8ba0-a0c2-4899-a188-5a03e11aad90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:04 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:18:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b57ee-3407-4f04-adc9-49fe16120ed7]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG os_brick.utils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:18:04 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating existing volume attachment record: c5e81d10-a5f5-4b56-a89b-261de8e897cf {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:18:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:18:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:15 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:18:15 user nova-compute[74507]: INFO nova.compute.claims [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Claim successful on node user
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:18:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.policy [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8bb37911dc54f07887a658d73bea2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51395d2b88b54d9b94b5861aac4c0b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:18:16 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Creating image(s)
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "/opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "/opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "/opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk 1073741824" returned: 0 in 0.061s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:16 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Successfully created port: 9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Cannot resize image /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Ensure instance console log exists: /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Successfully updated port: 9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquired lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-changed-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.compute.manager [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Refreshing instance network info cache due to event network-changed-9c23e1fa-fd8f-4958-9aac-e9d724f81e07. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] Acquiring lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.neutron [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Updating instance_info_cache with network_info: [{"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Releasing lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Instance network_info: |[{"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] Acquired lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.neutron [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Refreshing network info cache for port 9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Start _get_guest_xml network_info=[{"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:18:17 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:18:17 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740314688',display_name='tempest-VolumesActionsTest-instance-1740314688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740314688',id=49,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-9z323vg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:18:16Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=27fa2198-9fed-4fdb-8135-17aba300e750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lazy-loading 'pci_devices' on Instance uuid 27fa2198-9fed-4fdb-8135-17aba300e750 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:18:17 user nova-compute[74507]:   <uuid>27fa2198-9fed-4fdb-8135-17aba300e750</uuid>
Oct 25 23:18:17 user nova-compute[74507]:   <name>instance-00000031</name>
Oct 25 23:18:17 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:18:17 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:18:17 user nova-compute[74507]:   <metadata>
Oct 25 23:18:17 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:18:17 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:name>tempest-VolumesActionsTest-instance-1740314688</nova:name>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:18:17</nova:creationTime>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:18:17 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:18:17 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:owner>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:user uuid="a8bb37911dc54f07887a658d73bea2df">tempest-VolumesActionsTest-429168548-project-member</nova:user>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:project uuid="51395d2b88b54d9b94b5861aac4c0b03">tempest-VolumesActionsTest-429168548</nova:project>
Oct 25 23:18:17 user nova-compute[74507]:       </nova:owner>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:18:17 user nova-compute[74507]:       <nova:ports>
Oct 25 23:18:17 user nova-compute[74507]:         <nova:port uuid="9c23e1fa-fd8f-4958-9aac-e9d724f81e07">
Oct 25 23:18:17 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 23:18:17 user nova-compute[74507]:         </nova:port>
Oct 25 23:18:17 user nova-compute[74507]:       </nova:ports>
Oct 25 23:18:17 user nova-compute[74507]:     </nova:instance>
Oct 25 23:18:17 user nova-compute[74507]:   </metadata>
Oct 25 23:18:17 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:18:17 user nova-compute[74507]:     <system>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="serial">27fa2198-9fed-4fdb-8135-17aba300e750</entry>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="uuid">27fa2198-9fed-4fdb-8135-17aba300e750</entry>
Oct 25 23:18:17 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:18:17 user nova-compute[74507]:     </system>
Oct 25 23:18:17 user nova-compute[74507]:   </sysinfo>
Oct 25 23:18:17 user nova-compute[74507]:   <os>
Oct 25 23:18:17 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:18:17 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:18:17 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:18:17 user nova-compute[74507]:   </os>
Oct 25 23:18:17 user nova-compute[74507]:   <features>
Oct 25 23:18:17 user nova-compute[74507]:     <acpi/>
Oct 25 23:18:17 user nova-compute[74507]:     <apic/>
Oct 25 23:18:17 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:18:17 user nova-compute[74507]:   </features>
Oct 25 23:18:17 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:18:17 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:18:17 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:18:17 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:18:17 user nova-compute[74507]:   </clock>
Oct 25 23:18:17 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:18:17 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:18:17 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:18:17 user nova-compute[74507]:   </cpu>
Oct 25 23:18:17 user nova-compute[74507]:   <devices>
Oct 25 23:18:17 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:18:17 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:18:17 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk"/>
Oct 25 23:18:17 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:18:17 user nova-compute[74507]:     </disk>
Oct 25 23:18:17 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:18:17 user nova-compute[74507]:       <mac address="fa:16:3e:9f:00:5c"/>
Oct 25 23:18:17 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:18:17 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:18:17 user nova-compute[74507]:       <target dev="tap9c23e1fa-fd"/>
Oct 25 23:18:17 user nova-compute[74507]:     </interface>
Oct 25 23:18:17 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:18:17 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/console.log" append="off"/>
Oct 25 23:18:17 user nova-compute[74507]:     </serial>
Oct 25 23:18:17 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:18:17 user nova-compute[74507]:     <video>
Oct 25 23:18:17 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:18:17 user nova-compute[74507]:     </video>
Oct 25 23:18:17 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:18:17 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:18:17 user nova-compute[74507]:     </rng>
Oct 25 23:18:17 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:18:17 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:18:17 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:18:17 user nova-compute[74507]:     </memballoon>
Oct 25 23:18:17 user nova-compute[74507]:   </devices>
Oct 25 23:18:17 user nova-compute[74507]: </domain>
Oct 25 23:18:17 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740314688',display_name='tempest-VolumesActionsTest-instance-1740314688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740314688',id=49,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-9z323vg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:18:16Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=27fa2198-9fed-4fdb-8135-17aba300e750,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG os_vif [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9af11052-f2ba-5f75-b7d6-6d4525a05b42', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c23e1fa-fd, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c23e1fa-fd, col_values=(('qos', UUID('30e89fee-fbeb-4073-a491-f9ff02f2fdac')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c23e1fa-fd, col_values=(('external_ids', {'iface-id': '9c23e1fa-fd8f-4958-9aac-e9d724f81e07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:00:5c', 'vm-uuid': '27fa2198-9fed-4fdb-8135-17aba300e750'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:17 user nova-compute[74507]: INFO os_vif [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd')
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:17 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] No VIF found with MAC fa:16:3e:9f:00:5c, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:18:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Updated VIF entry in instance network info cache for port 9c23e1fa-fd8f-4958-9aac-e9d724f81e07. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:18:18 user nova-compute[74507]: DEBUG nova.network.neutron [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Updating instance_info_cache with network_info: [{"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:18:18 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-88031bda-3a95-4026-89bd-f3b6de0878bd req-f4899444-b349-4a2d-a3e0-6fee116232a4 service nova] Releasing lock "refresh_cache-27fa2198-9fed-4fdb-8135-17aba300e750" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] No waiting events found dispatching network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:18:19 user nova-compute[74507]: WARNING nova.compute.manager [req-9cc7a25d-1904-41c4-8e28-3bf1c999b98e req-eaaa131b-fc99-4f48-88a7-87cb096766d1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received unexpected event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 for instance with vm_state building and task_state spawning.
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCSwBHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:18:20 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:18:20 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:18:20 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec9adb-3853-4ab4-b092-949103c1815e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:18:20 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef654f-cefe-4172-9128-ecd4e73858c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52] added
Oct 25 23:18:20 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cb59fc-7485-441e-bb69-ba1c0ef2626b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aafc65-485f-4f28-a43f-fcda1123bb1c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCSwBHeK {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCSwBHeK" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0370c02f-8e6c-4cbc-8f61-0004945223dd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCSwBHeK'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[13739cb9-3790-4a6c-9d2c-66822a3e70c6]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a967cd8-a48b-43fb-a0a4-46d5bc97887f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:18:21 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:18:21 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:18:21 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:18:21 user nova-compute[74507]: 
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1e205d-640c-4bb2-a220-a0b4cb2525f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260]
Oct 25 23:18:21 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260] successful.
Oct 25 23:18:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6097e06-1ebe-4375-83b2-ee32453b8e72]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3fdf8-6dd5-4e41-92e8-5add88dbe819]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:21 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[552dc219-8d19-413d-b9ff-ed0dcbcf8643]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCSwBHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:18:21 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Instance spawned successfully.
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:18:21 user nova-compute[74507]: INFO nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] No waiting events found dispatching network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:18:21 user nova-compute[74507]: WARNING nova.compute.manager [req-ee664317-b648-4a80-9810-97fd944d923e req-6191977f-8b0e-4c39-8609-1086c78e53f1 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received unexpected event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 for instance with vm_state building and task_state spawning.
Oct 25 23:18:21 user nova-compute[74507]: INFO nova.compute.manager [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Took 5.60 seconds to build instance.
Oct 25 23:18:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6a1a7d63-912a-48f4-b235-bf91ac2a82c2 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.693s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23033353437313162', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033353437313162', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.objects.instance [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:18:22 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:18:22 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:18:22 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:18:22 user nova-compute[74507]:   <serial>3a4ea271-b4dc-4cfa-a9cd-fc8466860e52</serial>
Oct 25 23:18:22 user nova-compute[74507]: </disk>
Oct 25 23:18:22 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No VIF found with MAC fa:16:3e:e3:ac:07, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-0081c98c-ccc8-49d9-95a7-05c1fc1c2e87 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.787s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:26 user nova-compute[74507]: INFO nova.compute.manager [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attaching volume fd745e0d-be6d-4001-accb-0a324acbac3a to /dev/vdc
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.utils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f08854-e4fd-4214-a8b5-bb61668bc1d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[51202dc1-262e-4b64-ac9b-8fccfb01532f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fa5d1d-788d-4ca0-8bb8-676c21f68487]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f1ce9-c51f-4532-bd35-c7cdb00ad453]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:26 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:18:26 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb2280-3c39-40cd-875d-6b437343c513]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG os_brick.utils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:18:26 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating existing volume attachment record: 37a4ea02-c5c5-43de-ab26-5e86636014b2 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:18:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctZlVLjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:18:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:18:43 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:18:43 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf8f3a7-aff0-49cc-9259-7764f3ea520c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:18:43 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b8954-5cb3-4faa-838f-99e0116b7222]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a] added
Oct 25 23:18:43 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbd7393-f878-4cd6-8069-7ea60e3251fd]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:43 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4d71e0-487c-4132-bcfe-ade4d5498dda]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctZlVLjb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctZlVLjb" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d9797-011a-400e-8f57-2d8d5efee027]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctZlVLjb'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55a1e3-3bee-4d81-a5c1-10e8ae5d3be1]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ac8de9-a2f2-433e-9bf3-8f5218cdc090]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b752bb-2b6c-413f-8e79-5e9fe531666a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260]
Oct 25 23:18:44 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260] successful.
Oct 25 23:18:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0e95c-7f42-4e0e-b7fd-70aef350a9d0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a572970f-0f82-4ba9-898d-ba11bb985d25]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:44 user nova-compute[74507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)
Oct 25 23:18:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:18:44 user nova-compute[74507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)
Oct 25 23:18:44 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12839a71-1e7d-4e93-80b7-9a91ec989c8d]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:18:44 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctZlVLjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23061323330623761', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061323330623761', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:18:45 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:18:45 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:18:45 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:18:45 user nova-compute[74507]:   <serial>fd745e0d-be6d-4001-accb-0a324acbac3a</serial>
Oct 25 23:18:45 user nova-compute[74507]: </disk>
Oct 25 23:18:45 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] No VIF found with MAC fa:16:3e:e3:ac:07, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:18:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8dd304a8-7477-46e3-9a62-72965f65bc4f tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.464s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:46 user nova-compute[74507]: INFO nova.compute.manager [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Detaching volume fd745e0d-be6d-4001-accb-0a324acbac3a
Oct 25 23:18:47 user nova-compute[74507]: INFO nova.virt.block_device [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attempting to driver detach volume fd745e0d-be6d-4001-accb-0a324acbac3a from mountpoint /dev/vdc
Oct 25 23:18:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Attempting to detach device vdc from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:18:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:18:47 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:18:47 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:18:47 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:18:47 user nova-compute[74507]:   <serial>fd745e0d-be6d-4001-accb-0a324acbac3a</serial>
Oct 25 23:18:47 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 23:18:47 user nova-compute[74507]: </disk>
Oct 25 23:18:47 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:18:47 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully detached device vdc from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the persistent domain config.
Oct 25 23:18:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:18:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:18:47 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:18:47 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:18:47 user nova-compute[74507]:   <target dev="vdc" bus="virtio"/>
Oct 25 23:18:47 user nova-compute[74507]:   <serial>fd745e0d-be6d-4001-accb-0a324acbac3a</serial>
Oct 25 23:18:47 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 23:18:47 user nova-compute[74507]: </disk>
Oct 25 23:18:47 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:18:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:47 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:18:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-changed-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG nova.compute.manager [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Refreshing instance network info cache due to event network-changed-5a084df5-970e-4ff0-81bf-cf1ae28dba4a. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] Acquiring lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] Acquired lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG nova.network.neutron [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Refreshing network info cache for port 5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:18:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Ignoring supplied device name: /dev/vdb
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updated VIF entry in instance network info cache for port 5a084df5-970e-4ff0-81bf-cf1ae28dba4a. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG nova.network.neutron [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating instance_info_cache with network_info: [{"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-6c4b076c-d522-46d5-96c2-3726054c839f req-80fcb82b-96f8-4887-8094-6428fbb074c5 service nova] Releasing lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:18:50 user nova-compute[74507]: INFO nova.compute.manager [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Attaching volume 5a851a8f-d944-4f8f-bdea-7245814af77a to /dev/vdb
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.utils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6c2e12-57bd-4415-a596-c1881a5e381b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6759f-d2a0-4e32-b2a8-f03841ccd682]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05a3b3-855b-4d86-a841-0c6c098c641c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3154d6-3589-49af-a9d6-58b6770a0ecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:18:50 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:18:50 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c466f2-787e-4b2b-ae77-6af746f79fde]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG os_brick.utils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:18:50 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating existing volume attachment record: 8d7ed0c4-9897-4a41-9960-28e57bb01f8b {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:18:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:18:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:18:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:18:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:18:54 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [{"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:18:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-942e159b-ba7a-47ed-9d50-c02e941c3a65" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:18:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:18:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:18:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:18:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74507) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:03 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:04 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:19:04 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=24.880558013916016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 98b3f61e-6330-488b-9d85-f91644f98ba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 27fa2198-9fed-4fdb-8135-17aba300e750 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:19:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:19:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:07 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 is timed out.
Oct 25 23:19:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully detached device vdc from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the live domain config.
Oct 25 23:19:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctZlVLjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:19:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8201fe9-137f-4912-b44c-b95d46ba8297]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:19:07 user nova-compute[74507]: No targets found.
Oct 25 23:19:07 user nova-compute[74507]: iSNS:
Oct 25 23:19:07 user nova-compute[74507]: No targets found.
Oct 25 23:19:07 user nova-compute[74507]: STATIC:
Oct 25 23:19:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52
Oct 25 23:19:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:19:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:19:07 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a
Oct 25 23:19:07 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:19:07 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:19:07 user nova-compute[74507]: FIRMWARE:
Oct 25 23:19:07 user nova-compute[74507]: No targets found.
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:19:07 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:19:07 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71167c90-3a59-4ac6-a0e6-4926f4e07f3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[02358706-e965-48d5-b8fd-ed50443f3b33]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:07 user nova-compute[74507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:07 user nova-compute[74507]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a (non-flash)
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54474ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e1d01-8e72-44d9-9704-c8bbdbfee7cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23acc09-9f3e-4f73-82d1-569f1c088c63]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5729e64f-7df1-43d9-b467-61657628960c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8b75b-348b-4c95-b4b2-204cc74033ab]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e233682-ed2c-4538-bb6d-00e759f76227]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtMSlmWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:19:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52795d05-b912-4b9a-8dab-d968fb641114]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260]
Oct 25 23:19:07 user nova-compute[74507]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a, portal: 172.16.0.220,3260] successful.
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd745e0d-be6d-4001-accb-0a324acbac3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3f4a2a-1bc6-4d8c-be7c-120a6bf3e3c0]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== disconnect_volume: return (298ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.060s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:19:07 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:19:07 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[134aaae8-3308-4413-ad38-93d080c18561]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:19:07 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dffdc8-e102-4ed3-ab2f-985ed43c5c6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a] added
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a15ab-a08c-430b-8857-7a28530334fa]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[688b420f-3132-4396-b538-71277e62dd8f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtMSlmWi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtMSlmWi" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6db0ad-5899-41b8-8179-e6f7d5028cab]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtMSlmWi'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875ee2f-62e4-438c-868d-66d00d270125]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b94bc-99fd-471b-831d-604ba17da2e9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:07 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:19:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa918d2-5d9e-4cdc-b1cc-528e932d2f35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260]
Oct 25 23:19:08 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260] successful.
Oct 25 23:19:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d1022d-0ba6-4262-b6e9-cb6268f1ed9f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df602fd-336f-4bd6-93ee-6c523ccbc4a0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:08 user nova-compute[74507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:19:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:08 user nova-compute[74507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:19:08 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90e639a-b00e-4aa7-9199-66aa9abd50ea]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:19:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7ea82b28-a530-48ed-a609-667fcb797c0e tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtMSlmWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26166333038306535', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166333038306535', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:19:09 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:19:09 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:19:09 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:19:09 user nova-compute[74507]:   <serial>5a851a8f-d944-4f8f-bdea-7245814af77a</serial>
Oct 25 23:19:09 user nova-compute[74507]: </disk>
Oct 25 23:19:09 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] No VIF found with MAC fa:16:3e:ad:9d:19, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:19:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-a4893e68-1c3b-41b4-8630-921aa67ada88 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.499s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:19:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:19:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:19:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:19:37 user nova-compute[74507]: INFO nova.compute.manager [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Detaching volume 3a4ea271-b4dc-4cfa-a9cd-fc8466860e52
Oct 25 23:19:37 user nova-compute[74507]: INFO nova.virt.block_device [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Attempting to driver detach volume 3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 from mountpoint /dev/vdb
Oct 25 23:19:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Attempting to detach device vdb from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:19:37 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:19:37 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:19:37 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:19:37 user nova-compute[74507]:   <serial>3a4ea271-b4dc-4cfa-a9cd-fc8466860e52</serial>
Oct 25 23:19:37 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:19:37 user nova-compute[74507]: </disk>
Oct 25 23:19:37 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:19:37 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully detached device vdb from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the persistent domain config.
Oct 25 23:19:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:19:37 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:19:37 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:19:37 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:19:37 user nova-compute[74507]:   <serial>3a4ea271-b4dc-4cfa-a9cd-fc8466860e52</serial>
Oct 25 23:19:37 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:19:37 user nova-compute[74507]: </disk>
Oct 25 23:19:37 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:37 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:19:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:19:53 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:53 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:19:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:19:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:19:53 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:19:54 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating instance_info_cache with network_info: [{"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:19:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-98b3f61e-6330-488b-9d85-f91644f98ba5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:19:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:19:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:54 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:19:57 user nova-compute[74507]: INFO nova.compute.manager [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Detaching volume 5a851a8f-d944-4f8f-bdea-7245814af77a
Oct 25 23:19:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:19:57 user nova-compute[74507]: INFO nova.virt.block_device [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Attempting to driver detach volume 5a851a8f-d944-4f8f-bdea-7245814af77a from mountpoint /dev/vdb
Oct 25 23:19:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Attempting to detach device vdb from instance 98b3f61e-6330-488b-9d85-f91644f98ba5 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:19:57 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:19:57 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:19:57 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:19:57 user nova-compute[74507]:   <serial>5a851a8f-d944-4f8f-bdea-7245814af77a</serial>
Oct 25 23:19:57 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:19:57 user nova-compute[74507]: </disk>
Oct 25 23:19:57 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:19:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully detached device vdb from instance 98b3f61e-6330-488b-9d85-f91644f98ba5 from the persistent domain config.
Oct 25 23:19:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98b3f61e-6330-488b-9d85-f91644f98ba5 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:19:57 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:19:57 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:19:57 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:19:57 user nova-compute[74507]:   <serial>5a851a8f-d944-4f8f-bdea-7245814af77a</serial>
Oct 25 23:19:57 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:19:57 user nova-compute[74507]: </disk>
Oct 25 23:19:57 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:19:57 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 is timed out.
Oct 25 23:19:57 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully detached device vdb from instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 from the live domain config.
Oct 25 23:19:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCSwBHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:19:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:19:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:19:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af49a6d-83b5-441f-b5d0-16415b22e2b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:19:58 user nova-compute[74507]: No targets found.
Oct 25 23:19:58 user nova-compute[74507]: iSNS:
Oct 25 23:19:58 user nova-compute[74507]: No targets found.
Oct 25 23:19:58 user nova-compute[74507]: STATIC:
Oct 25 23:19:58 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52
Oct 25 23:19:58 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:19:58 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:19:58 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a
Oct 25 23:19:58 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:19:58 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:19:58 user nova-compute[74507]: FIRMWARE:
Oct 25 23:19:58 user nova-compute[74507]: No targets found.
Oct 25 23:19:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:19:58 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:19:58 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f82dd5-2954-4245-863a-f7fa2d020833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ab8f2e-c8ef-4862-9355-c1e6cd0f71ab]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:58 user nova-compute[74507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:19:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 (non-flash)
Oct 25 23:19:58 user nova-compute[74507]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:19:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54474ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b9837-bc9e-4bd8-a5bf-c640310b9cea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f4d2cb-6fb2-4b2d-a0ec-93fd1e6d0aff]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39626b7a-4213-46b6-b2a7-be38b1ef882c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87612eb3-97b2-4cf1-b91a-3ecea5c45f09]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d0846-d7e0-41f2-9e27-8d5c99e10ada]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da0717-4d70-4818-9ddd-4f70a55b0383]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260]
Oct 25 23:19:58 user nova-compute[74507]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52, portal: 172.16.0.220,3260] successful.
Oct 25 23:19:58 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4ea271-b4dc-4cfa-a9cd-fc8466860e52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb89ac6-cf49-414a-a700-2380d6034f23]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] <== disconnect_volume: return (293ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:19:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:19:59 user nova-compute[74507]: DEBUG nova.objects.instance [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'flavor' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:19:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-dae297b4-114d-45a9-ac7a-190c655b150d tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:20:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=24.879066467285156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:06 user nova-compute[74507]: INFO nova.compute.manager [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Terminating instance
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 98b3f61e-6330-488b-9d85-f91644f98ba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 27fa2198-9fed-4fdb-8135-17aba300e750 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:20:06 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-unplugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] No waiting events found dispatching network-vif-unplugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.compute.manager [req-bfdaf615-ad1b-4d7b-9dee-cfcb5f39dbc4 req-e6302641-3026-41a5-bd01-52d462f1ff3a service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-unplugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Instance destroyed successfully.
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lazy-loading 'resources' on Instance uuid 27fa2198-9fed-4fdb-8135-17aba300e750 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740314688',display_name='tempest-VolumesActionsTest-instance-1740314688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740314688',id=49,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51395d2b88b54d9b94b5861aac4c0b03',ramdisk_id='',reservation_id='r-9z323vg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-429168548',owner_user_name='tempest-VolumesActionsTest-429168548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:18:21Z,user_data=None,user_id='a8bb37911dc54f07887a658d73bea2df',uuid=27fa2198-9fed-4fdb-8135-17aba300e750,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converting VIF {"id": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "address": "fa:16:3e:9f:00:5c", "network": {"id": "78fa0384-dd9e-41a5-ad21-4e1877dae210", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133113420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51395d2b88b54d9b94b5861aac4c0b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c23e1fa-fd", "ovs_interfaceid": "9c23e1fa-fd8f-4958-9aac-e9d724f81e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG os_vif [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c23e1fa-fd, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30e89fee-fbeb-4073-a491-f9ff02f2fdac) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:07 user nova-compute[74507]: INFO os_vif [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:00:5c,bridge_name='br-int',has_traffic_filtering=True,id=9c23e1fa-fd8f-4958-9aac-e9d724f81e07,network=Network(78fa0384-dd9e-41a5-ad21-4e1877dae210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c23e1fa-fd')
Oct 25 23:20:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Deleting instance files /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750_del
Oct 25 23:20:07 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Deletion of /opt/stack/data/nova/instances/27fa2198-9fed-4fdb-8135-17aba300e750_del complete
Oct 25 23:20:07 user nova-compute[74507]: INFO nova.compute.manager [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 23:20:07 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:20:07 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:20:08 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Took 0.54 seconds to deallocate network for instance.
Oct 25 23:20:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-d3be2472-e24a-40a9-bd11-c586ea6ede75 req-794f58fb-ee85-4894-beda-2b7a240dc867 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-deleted-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:20:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:08 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Deleted allocations for instance 27fa2198-9fed-4fdb-8135-17aba300e750
Oct 25 23:20:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4718b37d-7dd4-4c47-bfaa-6908ed7b8749 tempest-VolumesActionsTest-429168548 tempest-VolumesActionsTest-429168548-project-member] Lock "27fa2198-9fed-4fdb-8135-17aba300e750" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] Acquiring lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] Lock "27fa2198-9fed-4fdb-8135-17aba300e750-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:09 user nova-compute[74507]: DEBUG nova.compute.manager [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] No waiting events found dispatching network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:09 user nova-compute[74507]: WARNING nova.compute.manager [req-a2721f1d-3d27-43bb-aa08-cfdf97c40c3d req-6ca19416-505f-4181-a6db-959cf29a3122 service nova] [instance: 27fa2198-9fed-4fdb-8135-17aba300e750] Received unexpected event network-vif-plugged-9c23e1fa-fd8f-4958-9aac-e9d724f81e07 for instance with vm_state deleted and task_state None.
Oct 25 23:20:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:18 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98b3f61e-6330-488b-9d85-f91644f98ba5 is timed out.
Oct 25 23:20:18 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully detached device vdb from instance 98b3f61e-6330-488b-9d85-f91644f98ba5 from the live domain config.
Oct 25 23:20:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtMSlmWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:20:18 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c33e132-83ed-431c-940a-b1dc61ec8390]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:20:18 user nova-compute[74507]: No targets found.
Oct 25 23:20:18 user nova-compute[74507]: iSNS:
Oct 25 23:20:18 user nova-compute[74507]: No targets found.
Oct 25 23:20:18 user nova-compute[74507]: STATIC:
Oct 25 23:20:18 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a
Oct 25 23:20:18 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:20:18 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:20:18 user nova-compute[74507]: FIRMWARE:
Oct 25 23:20:18 user nova-compute[74507]: No targets found.
Oct 25 23:20:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:20:18 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:20:18 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4274fb-7862-491a-aed8-bf33dbf42ea4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10ac95-e1b7-4015-b3c7-52a01ef87316]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:20:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a (non-flash)
Oct 25 23:20:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b54678670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72b7a1f-41c4-40f2-9554-46e2a78158f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c94737-cd18-44e9-b36d-13117ef10640]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a411e85d-ad27-4921-922d-93691d06b9d4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896c244-4cd8-4be2-a4c6-cc86a700086b]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[102e2244-4c20-4baa-ba21-1b0cb3dd0e13]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[292d32c3-51da-4eba-ac54-62b8cf43c018]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260]
Oct 25 23:20:18 user nova-compute[74507]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a, portal: 172.16.0.220,3260] successful.
Oct 25 23:20:18 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5f016-afca-485f-aff2-785593ffa882]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== disconnect_volume: return (273ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:20:18 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'flavor' on Instance uuid 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4ff17454-1b49-45f5-ac26-6cbbd91b811d tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.555s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:19 user nova-compute[74507]: INFO nova.compute.manager [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Terminating instance
Oct 25 23:20:19 user nova-compute[74507]: DEBUG nova.compute.manager [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-unplugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] No waiting events found dispatching network-vif-unplugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:19 user nova-compute[74507]: DEBUG nova.compute.manager [req-8e5d2543-c179-4dfb-ae31-04f2e0999050 req-84d510b7-5225-4b99-8784-5307a6ae8492 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-unplugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:20:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Instance destroyed successfully.
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.objects.instance [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lazy-loading 'resources' on Instance uuid 98b3f61e-6330-488b-9d85-f91644f98ba5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1892705917',display_name='tempest-VolumesSnapshotTestJSON-instance-1892705917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1892705917',id=48,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIAgA6GB1t3oAl+8X3z/nEl6h06qPDmtOTZWWrC6QgyZHSsn4YuHIb36ni3XJVbQhHgndBsC8P5heAtbxUiEu8syVZGzXsgX0a1JONT9p33tDGvgKubUkl+A0oEhQ+mRg==',key_name='tempest-keypair-1611989880',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b9bdeae9415da4bf6c96bb4f7b1c',ramdisk_id='',reservation_id='r-4azjqmo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1984329490',owner_user_name='tempest-VolumesSnapshotTestJSON-1984329490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d05b04dc684a4db5d1055283fdbd74',uuid=98b3f61e-6330-488b-9d85-f91644f98ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converting VIF {"id": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "address": "fa:16:3e:ad:9d:19", "network": {"id": "d40d2c62-70f2-49fb-b916-17749d197f1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-79357456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b9bdeae9415da4bf6c96bb4f7b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a084df5-97", "ovs_interfaceid": "5a084df5-970e-4ff0-81bf-cf1ae28dba4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_vif [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a084df5-97, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9db13871-036e-4b26-86d5-7354b8770933) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:20 user nova-compute[74507]: INFO os_vif [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:9d:19,bridge_name='br-int',has_traffic_filtering=True,id=5a084df5-970e-4ff0-81bf-cf1ae28dba4a,network=Network(d40d2c62-70f2-49fb-b916-17749d197f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a084df5-97')
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a851a8f-d944-4f8f-bdea-7245814af77a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtMSlmWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:20:20 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[079b91b9-09b6-408d-9464-a4e992779a8d]: Unexpected error while running command.
Oct 25 23:20:20 user nova-compute[74507]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 23:20:20 user nova-compute[74507]: Exit code: 21
Oct 25 23:20:20 user nova-compute[74507]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 23:20:20 user nova-compute[74507]: Stderr: '' {{(pid=86030) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 25 23:20:20 user nova-compute[74507]: Traceback (most recent call last):
Oct 25 23:20:20 user nova-compute[74507]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 25 23:20:20 user nova-compute[74507]:     ret = func(*f_args, **f_kwargs)
Oct 25 23:20:20 user nova-compute[74507]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 25 23:20:20 user nova-compute[74507]:     return func(*args, **kwargs)
Oct 25 23:20:20 user nova-compute[74507]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 25 23:20:20 user nova-compute[74507]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 25 23:20:20 user nova-compute[74507]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 25 23:20:20 user nova-compute[74507]:     return putils.execute(on_execute=on_execute,
Oct 25 23:20:20 user nova-compute[74507]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 25 23:20:20 user nova-compute[74507]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 25 23:20:20 user nova-compute[74507]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 23:20:20 user nova-compute[74507]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 23:20:20 user nova-compute[74507]: Exit code: 21
Oct 25 23:20:20 user nova-compute[74507]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 23:20:20 user nova-compute[74507]: Stderr: ''
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b91b9-09b6-408d-9464-a4e992779a8d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 23:20:20 user nova-compute[74507]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 23:20:20 user nova-compute[74507]: Exit code: 21
Oct 25 23:20:20 user nova-compute[74507]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 23:20:20 user nova-compute[74507]: Stderr: ''
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 25 23:20:20 user nova-compute[74507]: ERROR os_brick.initiator.connectors.iscsi 
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74507) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] <== disconnect_volume: return (36ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:20:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Deleting instance files /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5_del
Oct 25 23:20:20 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Deletion of /opt/stack/data/nova/instances/98b3f61e-6330-488b-9d85-f91644f98ba5_del complete
Oct 25 23:20:20 user nova-compute[74507]: INFO nova.compute.manager [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 23:20:20 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:20:20 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:20:21 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Took 0.84 seconds to deallocate network for instance.
Oct 25 23:20:21 user nova-compute[74507]: WARNING nova.volume.cinder [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Attachment 8d7ed0c4-9897-4a41-9960-28e57bb01f8b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8d7ed0c4-9897-4a41-9960-28e57bb01f8b. (HTTP 404) (Request-ID: req-e03e8c02-8cfa-40c0-90a6-4464b99a7da1)
Oct 25 23:20:21 user nova-compute[74507]: INFO nova.compute.manager [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Took 0.03 seconds to detach 1 volumes for instance.
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:21 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Deleted allocations for instance 98b3f61e-6330-488b-9d85-f91644f98ba5
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-6ff7bf11-8d08-4e09-99f6-c912aa5f6377 tempest-VolumesSnapshotTestJSON-1984329490 tempest-VolumesSnapshotTestJSON-1984329490-project-member] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] Acquiring lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] Lock "98b3f61e-6330-488b-9d85-f91644f98ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] No waiting events found dispatching network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:21 user nova-compute[74507]: WARNING nova.compute.manager [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received unexpected event network-vif-plugged-5a084df5-970e-4ff0-81bf-cf1ae28dba4a for instance with vm_state deleted and task_state None.
Oct 25 23:20:21 user nova-compute[74507]: DEBUG nova.compute.manager [req-8c9f59b4-1459-4c95-8924-f573636fd07d req-86744263-34a3-44bf-a352-fada77a05350 service nova] [instance: 98b3f61e-6330-488b-9d85-f91644f98ba5] Received event network-vif-deleted-5a084df5-970e-4ff0-81bf-cf1ae28dba4a {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:27 user nova-compute[74507]: INFO nova.compute.manager [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Terminating instance
Oct 25 23:20:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-unplugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] No waiting events found dispatching network-vif-unplugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-c9e1db97-3b04-4604-98ee-14409ecf6015 req-b58ff7a3-43c7-4d6c-be4f-7ca873e7f090 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-unplugged-10e3b647-ff34-4209-b333-afa9a77785b3 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:20:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Instance destroyed successfully.
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.objects.instance [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lazy-loading 'resources' on Instance uuid 942e159b-ba7a-47ed-9d50-c02e941c3a65 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:16:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1528738071',display_name='tempest-TestServerVolumeAttachmentScenario-server-1528738071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1528738071',id=47,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCvcS8JdoPGqnn28IsgcNindz4z8j/NbxgaH3s3eEt3VmzhD8Ulz3L6EpU7WM9TdThRjrHEBciyKdmLa21DJvZktt0jmPZLENTRLW44540QnjZelYSfPxysg7lyuyZGeg==',key_name='tempest-keypair-1675751534',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:16:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4dc320f598644d4987ebe8b3903f1f1',ramdisk_id='',reservation_id='r-olblby2e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-562683234',owner_user_name='tempest-TestServerVolumeAttachmentScenario-562683234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c70cb4f053c1476daa7371c12830eece',uuid=942e159b-ba7a-47ed-9d50-c02e941c3a65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converting VIF {"id": "10e3b647-ff34-4209-b333-afa9a77785b3", "address": "fa:16:3e:e3:ac:07", "network": {"id": "c51fd390-630f-4050-bad4-2d4e53252605", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1118330487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dc320f598644d4987ebe8b3903f1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e3b647-ff", "ovs_interfaceid": "10e3b647-ff34-4209-b333-afa9a77785b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG os_vif [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e3b647-ff, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e62ea97-0701-48f4-9e38-88d57e597847) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:28 user nova-compute[74507]: INFO os_vif [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:ac:07,bridge_name='br-int',has_traffic_filtering=True,id=10e3b647-ff34-4209-b333-afa9a77785b3,network=Network(c51fd390-630f-4050-bad4-2d4e53252605),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e3b647-ff')
Oct 25 23:20:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Deleting instance files /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65_del
Oct 25 23:20:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Deletion of /opt/stack/data/nova/instances/942e159b-ba7a-47ed-9d50-c02e941c3a65_del complete
Oct 25 23:20:28 user nova-compute[74507]: INFO nova.compute.manager [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 25 23:20:28 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:20:28 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:20:29 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Took 0.79 seconds to deallocate network for instance.
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-ff9612e7-127f-4ffb-a5b4-44ac8fa43f8f req-069fa4a5-4b6e-4942-bb05-26f6105f29ea service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-deleted-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:29 user nova-compute[74507]: INFO nova.compute.manager [req-ff9612e7-127f-4ffb-a5b4-44ac8fa43f8f req-069fa4a5-4b6e-4942-bb05-26f6105f29ea service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Neutron deleted interface 10e3b647-ff34-4209-b333-afa9a77785b3; detaching it from the instance and deleting it from the info cache
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.network.neutron [req-ff9612e7-127f-4ffb-a5b4-44ac8fa43f8f req-069fa4a5-4b6e-4942-bb05-26f6105f29ea service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-ff9612e7-127f-4ffb-a5b4-44ac8fa43f8f req-069fa4a5-4b6e-4942-bb05-26f6105f29ea service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Detach interface failed, port_id=10e3b647-ff34-4209-b333-afa9a77785b3, reason: Instance 942e159b-ba7a-47ed-9d50-c02e941c3a65 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:20:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:29 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Deleted allocations for instance 942e159b-ba7a-47ed-9d50-c02e941c3a65
Oct 25 23:20:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-80832d9b-e479-4f75-a49e-2ae12ec36660 tempest-TestServerVolumeAttachmentScenario-562683234 tempest-TestServerVolumeAttachmentScenario-562683234-project-member] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:20:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] Acquiring lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:20:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:20:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] Lock "942e159b-ba7a-47ed-9d50-c02e941c3a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:20:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] No waiting events found dispatching network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:20:30 user nova-compute[74507]: WARNING nova.compute.manager [req-0e1c12b7-775e-49e0-af01-6412e034ee03 req-56de23d5-476c-41be-9f10-c1878e0e56d3 service nova] [instance: 942e159b-ba7a-47ed-9d50-c02e941c3a65] Received unexpected event network-vif-plugged-10e3b647-ff34-4209-b333-afa9a77785b3 for instance with vm_state deleted and task_state None.
Oct 25 23:20:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:20:55 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid de575cf3-3998-4ca6-b46d-1ca07ee17ec5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [{"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-de575cf3-3998-4ca6-b46d-1ca07ee17ec5" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:20:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:20:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:21:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:21:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:21:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=24.95336151123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:21:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Verify base images {{(pid=74507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Image id 541b34fc-25d4-4dab-841b-3fd7e92cb423 yields fingerprint f19771e884cacf0122f298fa090fb3f7faa6dbab {{(pid=74507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] image 541b34fc-25d4-4dab-841b-3fd7e92cb423 at (/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab): checking
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] image 541b34fc-25d4-4dab-841b-3fd7e92cb423 at (/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab): image is in use {{(pid=74507) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] de575cf3-3998-4ca6-b46d-1ca07ee17ec5 is a valid instance name {{(pid=74507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] de575cf3-3998-4ca6-b46d-1ca07ee17ec5 has a disk file {{(pid=74507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 is backed by f19771e884cacf0122f298fa090fb3f7faa6dbab {{(pid=74507) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf
Oct 25 23:21:20 user nova-compute[74507]: WARNING nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Unknown base file: /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Active base files: /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Removable base files: /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498 /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36 /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442 /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3 /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f635c95620720dade80261b7b30f773f64ea2498
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/37e5c1914c623ee74e1cca68c1b11b07324a5e36
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/08a696b82d92840968371cef0caf612bcbea1ddf
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c38052184856dcc4bb0874effb59cffe4db8442
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d10788b3861cead58cd8e5d020ab3a8d5f616a3b
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/06188b59c973150c435ea289dbe823ebab0e2ae3
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a5604c8998053725ba1fb7c2cd9bd62d68c2adf
Oct 25 23:21:20 user nova-compute[74507]: INFO nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/55e7c84ae1be8bcbc6efcead5a18928a7c177622
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Verification complete {{(pid=74507) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Verify swap images {{(pid=74507) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 25 23:21:20 user nova-compute[74507]: DEBUG nova.virt.libvirt.imagecache [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Verify ephemeral images {{(pid=74507) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 25 23:21:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:28 user nova-compute[74507]: INFO nova.compute.manager [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Terminating instance
Oct 25 23:21:28 user nova-compute[74507]: DEBUG nova.compute.manager [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-8f2aca8f-039b-44bd-b682-c62b74aaf577 req-d22115e3-041b-4a6b-99fb-e85456c4ec81 service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Instance destroyed successfully.
Oct 25 23:21:29 user nova-compute[74507]: DEBUG nova.objects.instance [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lazy-loading 'resources' on Instance uuid de575cf3-3998-4ca6-b46d-1ca07ee17ec5 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1480507615',display_name='tempest-ServersNegativeTestJSON-server-1480507615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1480507615',id=43,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:12:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d19559e778f4a25b2764ae9a1d820a1',ramdisk_id='',reservation_id='r-clf8j8td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-343182396',owner_user_name='tempest-ServersNegativeTestJSON-343182396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:12:30Z,user_data=None,user_id='296b63e942ff4708941cc09ab8feb39a',uuid=de575cf3-3998-4ca6-b46d-1ca07ee17ec5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converting VIF {"id": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "address": "fa:16:3e:29:c5:24", "network": {"id": "bb662d80-ee83-4662-b414-b2e4d2fd5da7", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1809532005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d19559e778f4a25b2764ae9a1d820a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9960019b-e4", "ovs_interfaceid": "9960019b-e423-443f-aa4a-2ef3e13b7e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG os_vif [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9960019b-e4, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c0f5d2-2cf9-403e-ad53-640fbacfd76c) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:29 user nova-compute[74507]: INFO os_vif [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c5:24,bridge_name='br-int',has_traffic_filtering=True,id=9960019b-e423-443f-aa4a-2ef3e13b7e49,network=Network(bb662d80-ee83-4662-b414-b2e4d2fd5da7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9960019b-e4')
Oct 25 23:21:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Deleting instance files /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5_del
Oct 25 23:21:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Deletion of /opt/stack/data/nova/instances/de575cf3-3998-4ca6-b46d-1ca07ee17ec5_del complete
Oct 25 23:21:30 user nova-compute[74507]: INFO nova.compute.manager [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Took 1.93 seconds to destroy the instance on the hypervisor.
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:30 user nova-compute[74507]: WARNING nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state active and task_state deleting.
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:30 user nova-compute[74507]: WARNING nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state active and task_state deleting.
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:30 user nova-compute[74507]: WARNING nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state active and task_state deleting.
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-46c1026b-f270-44ee-bedd-8199bcd382d5 req-e7b8b2b0-c374-4396-9ff6-402df8486a6e service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-unplugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:21:31 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:21:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-857ec3af-ea3d-409c-aa7f-ab13dcc49345 req-5fd15137-55f4-421b-8622-89a047f155da service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-deleted-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:31 user nova-compute[74507]: INFO nova.compute.manager [req-857ec3af-ea3d-409c-aa7f-ab13dcc49345 req-5fd15137-55f4-421b-8622-89a047f155da service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Neutron deleted interface 9960019b-e423-443f-aa4a-2ef3e13b7e49; detaching it from the instance and deleting it from the info cache
Oct 25 23:21:31 user nova-compute[74507]: DEBUG nova.network.neutron [req-857ec3af-ea3d-409c-aa7f-ab13dcc49345 req-5fd15137-55f4-421b-8622-89a047f155da service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:21:31 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Took 1.83 seconds to deallocate network for instance.
Oct 25 23:21:31 user nova-compute[74507]: DEBUG nova.compute.manager [req-857ec3af-ea3d-409c-aa7f-ab13dcc49345 req-5fd15137-55f4-421b-8622-89a047f155da service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Detach interface failed, port_id=9960019b-e423-443f-aa4a-2ef3e13b7e49, reason: Instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5 could not be found. {{(pid=74507) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:32 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Deleted allocations for instance de575cf3-3998-4ca6-b46d-1ca07ee17ec5
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-91e57a43-a6e3-4e80-b9d9-328479c07cc2 tempest-ServersNegativeTestJSON-343182396 tempest-ServersNegativeTestJSON-343182396-project-member] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.677s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] Acquiring lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] Lock "de575cf3-3998-4ca6-b46d-1ca07ee17ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:21:32 user nova-compute[74507]: DEBUG nova.compute.manager [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] No waiting events found dispatching network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:21:32 user nova-compute[74507]: WARNING nova.compute.manager [req-74f3ef95-0b3c-4631-893d-66412990e84f req-4f6bbb2b-e629-450e-9d5b-ce6733b46e5b service nova] [instance: de575cf3-3998-4ca6-b46d-1ca07ee17ec5] Received unexpected event network-vif-plugged-9960019b-e423-443f-aa4a-2ef3e13b7e49 for instance with vm_state deleted and task_state None.
Oct 25 23:21:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:21:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:51 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:21:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:21:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 23:21:56 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:57 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:21:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:22:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:22:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.977584838867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:22:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:22:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:22:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:22:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:23 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:28 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:22:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:37 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:22:37 user nova-compute[74507]: INFO nova.compute.claims [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Claim successful on node user
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:22:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:22:38 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Creating image(s)
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "/opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "/opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "/opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG nova.policy [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f630b058335a47579cb8b13b7def1c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14592e5e77d417180dc03c2ac806bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.195s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk 1073741824" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:38 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Checking if we can resize image /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Cannot resize image /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Ensure instance console log exists: /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Successfully created port: 4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Successfully updated port: 4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquired lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:22:39 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-changed-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.compute.manager [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Refreshing instance network info cache due to event network-changed-4688237a-db5e-492a-9c76-f469f282cd32. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] Acquiring lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.neutron [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updating instance_info_cache with network_info: [{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Releasing lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Instance network_info: |[{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] Acquired lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Refreshing network info cache for port 4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Start _get_guest_xml network_info=[{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:22:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:22:40 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-286043195',display_name='tempest-VolumesNegativeTest-instance-286043195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-286043195',id=50,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14592e5e77d417180dc03c2ac806bfb',ramdisk_id='',reservation_id='r-ifa7chza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1696852972',owner_user_name='tempest-VolumesNegativeTest-1696852972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:22:38Z,user_data=None,user_id='f630b058335a47579cb8b13b7def1c7b',uuid=512501d2-d2e3-42f4-82fc-368e6df60bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converting VIF {"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.objects.instance [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lazy-loading 'pci_devices' on Instance uuid 512501d2-d2e3-42f4-82fc-368e6df60bb1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:22:40 user nova-compute[74507]:   <uuid>512501d2-d2e3-42f4-82fc-368e6df60bb1</uuid>
Oct 25 23:22:40 user nova-compute[74507]:   <name>instance-00000032</name>
Oct 25 23:22:40 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:22:40 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:22:40 user nova-compute[74507]:   <metadata>
Oct 25 23:22:40 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:22:40 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:name>tempest-VolumesNegativeTest-instance-286043195</nova:name>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:22:40</nova:creationTime>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:22:40 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:22:40 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:owner>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:user uuid="f630b058335a47579cb8b13b7def1c7b">tempest-VolumesNegativeTest-1696852972-project-member</nova:user>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:project uuid="e14592e5e77d417180dc03c2ac806bfb">tempest-VolumesNegativeTest-1696852972</nova:project>
Oct 25 23:22:40 user nova-compute[74507]:       </nova:owner>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:22:40 user nova-compute[74507]:       <nova:ports>
Oct 25 23:22:40 user nova-compute[74507]:         <nova:port uuid="4688237a-db5e-492a-9c76-f469f282cd32">
Oct 25 23:22:40 user nova-compute[74507]:           <nova:ip type="fixed" address="192.168.233.211" ipVersion="4"/>
Oct 25 23:22:40 user nova-compute[74507]:         </nova:port>
Oct 25 23:22:40 user nova-compute[74507]:       </nova:ports>
Oct 25 23:22:40 user nova-compute[74507]:     </nova:instance>
Oct 25 23:22:40 user nova-compute[74507]:   </metadata>
Oct 25 23:22:40 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:22:40 user nova-compute[74507]:     <system>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="serial">512501d2-d2e3-42f4-82fc-368e6df60bb1</entry>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="uuid">512501d2-d2e3-42f4-82fc-368e6df60bb1</entry>
Oct 25 23:22:40 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:22:40 user nova-compute[74507]:     </system>
Oct 25 23:22:40 user nova-compute[74507]:   </sysinfo>
Oct 25 23:22:40 user nova-compute[74507]:   <os>
Oct 25 23:22:40 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:22:40 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:22:40 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:22:40 user nova-compute[74507]:   </os>
Oct 25 23:22:40 user nova-compute[74507]:   <features>
Oct 25 23:22:40 user nova-compute[74507]:     <acpi/>
Oct 25 23:22:40 user nova-compute[74507]:     <apic/>
Oct 25 23:22:40 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:22:40 user nova-compute[74507]:   </features>
Oct 25 23:22:40 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:22:40 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:22:40 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:22:40 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:22:40 user nova-compute[74507]:   </clock>
Oct 25 23:22:40 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:22:40 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:22:40 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:22:40 user nova-compute[74507]:   </cpu>
Oct 25 23:22:40 user nova-compute[74507]:   <devices>
Oct 25 23:22:40 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:22:40 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:22:40 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk"/>
Oct 25 23:22:40 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:22:40 user nova-compute[74507]:     </disk>
Oct 25 23:22:40 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:22:40 user nova-compute[74507]:       <mac address="fa:16:3e:53:41:7e"/>
Oct 25 23:22:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:22:40 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:22:40 user nova-compute[74507]:       <target dev="tap4688237a-db"/>
Oct 25 23:22:40 user nova-compute[74507]:     </interface>
Oct 25 23:22:40 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:22:40 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/console.log" append="off"/>
Oct 25 23:22:40 user nova-compute[74507]:     </serial>
Oct 25 23:22:40 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:22:40 user nova-compute[74507]:     <video>
Oct 25 23:22:40 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:22:40 user nova-compute[74507]:     </video>
Oct 25 23:22:40 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:22:40 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:22:40 user nova-compute[74507]:     </rng>
Oct 25 23:22:40 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:22:40 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:22:40 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:22:40 user nova-compute[74507]:     </memballoon>
Oct 25 23:22:40 user nova-compute[74507]:   </devices>
Oct 25 23:22:40 user nova-compute[74507]: </domain>
Oct 25 23:22:40 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-286043195',display_name='tempest-VolumesNegativeTest-instance-286043195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-286043195',id=50,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14592e5e77d417180dc03c2ac806bfb',ramdisk_id='',reservation_id='r-ifa7chza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1696852972',owner_user_name='tempest-VolumesNegativeTest-1696852972-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:22:38Z,user_data=None,user_id='f630b058335a47579cb8b13b7def1c7b',uuid=512501d2-d2e3-42f4-82fc-368e6df60bb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converting VIF {"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG os_vif [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b376c55-20a5-5309-8e33-cfb6cf96e07b', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4688237a-db, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4688237a-db, col_values=(('qos', UUID('4f49b680-63fa-4755-b6c2-aed6ad8bff6d')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4688237a-db, col_values=(('external_ids', {'iface-id': '4688237a-db5e-492a-9c76-f469f282cd32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:41:7e', 'vm-uuid': '512501d2-d2e3-42f4-82fc-368e6df60bb1'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:40 user nova-compute[74507]: INFO os_vif [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db')
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] No VIF found with MAC fa:16:3e:53:41:7e, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updated VIF entry in instance network info cache for port 4688237a-db5e-492a-9c76-f469f282cd32. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG nova.network.neutron [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updating instance_info_cache with network_info: [{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:22:40 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4a27bd64-bf6e-4208-87f5-ac93f4dbcfa1 req-7985d2a2-7965-470c-b496-3050bc261c0e service nova] Releasing lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:22:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:41 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG nova.compute.manager [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] No waiting events found dispatching network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:22:42 user nova-compute[74507]: WARNING nova.compute.manager [req-4fcd026a-ab6a-4ab7-a362-875c726d8c22 req-aafd6a19-6c65-49ee-96ec-be90cf989dfd service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received unexpected event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 for instance with vm_state building and task_state spawning.
Oct 25 23:22:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:22:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Instance spawned successfully.
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.compute.manager [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] No waiting events found dispatching network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:22:44 user nova-compute[74507]: WARNING nova.compute.manager [req-e411ac7c-fac1-4160-92ee-e8fd88bc7960 req-242d96ec-ebee-408a-9698-cbc5de2b2349 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received unexpected event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 for instance with vm_state building and task_state spawning.
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:22:44 user nova-compute[74507]: INFO nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Took 6.07 seconds to spawn the instance on the hypervisor.
Oct 25 23:22:44 user nova-compute[74507]: DEBUG nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:22:44 user nova-compute[74507]: INFO nova.compute.manager [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Took 6.62 seconds to build instance.
Oct 25 23:22:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-690fdfac-13a5-4607-9cc7-8bc3d18bfe19 tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:22:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:22:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid 512501d2-d2e3-42f4-82fc-368e6df60bb1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updating instance_info_cache with network_info: [{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:22:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:23:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:23:05 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=24.939937591552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 512501d2-d2e3-42f4-82fc-368e6df60bb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:23:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:23:07 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:23:10 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:15 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:20 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:25 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:30 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:35 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:45 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:50 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:23:54 user nova-compute[74507]: INFO nova.compute.claims [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Claim successful on node user
Oct 25 23:23:54 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:54 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:23:55 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.policy [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1248327921b842d596e8159d9792bab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4725ed100149debf93e17bee94486a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:23:55 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Creating image(s)
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "/opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "/opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "/opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.180s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk 1073741824" returned: 0 in 0.064s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.199s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:23:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Successfully created port: 31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Cannot resize image /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Ensure instance console log exists: /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Successfully updated port: 31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-changed-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.compute.manager [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Refreshing instance network info cache due to event network-changed-31051495-7b84-468a-9397-ee47549a1baf. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Instance network_info: |[{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.network.neutron [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Refreshing network info cache for port 31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:23:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Start _get_guest_xml network_info=[{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:23:57 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:23:57 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-771108665',display_name='tempest-SnapshotDataIntegrityTests-server-771108665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-771108665',id=51,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44eb7p7lGLQ8/HPgl9mSqmvfhWAL3bnsQQvUcCM9JkBAylJz3m1LF4T0waoSnIjWlPvUmaKAFEAh60MXlBGjJ6Fq0juSxMtuiGWM6+S/2nWRfV79r9YWxCdeW9qqadkA==',key_name='tempest-keypair-708062190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f4725ed100149debf93e17bee94486a',ramdisk_id='',reservation_id='r-inh15lhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-523073368',owner_user_name='tempest-SnapshotDataIntegrityTests-523073368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1248327921b842d596e8159d9792bab5',uuid=a29c5199-d429-4d09-8298-c0ef3f96f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converting VIF {"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.objects.instance [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'pci_devices' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:23:57 user nova-compute[74507]:   <uuid>a29c5199-d429-4d09-8298-c0ef3f96f586</uuid>
Oct 25 23:23:57 user nova-compute[74507]:   <name>instance-00000033</name>
Oct 25 23:23:57 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:23:57 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:23:57 user nova-compute[74507]:   <metadata>
Oct 25 23:23:57 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:23:57 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-771108665</nova:name>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:23:57</nova:creationTime>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:23:57 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:23:57 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:owner>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:user uuid="1248327921b842d596e8159d9792bab5">tempest-SnapshotDataIntegrityTests-523073368-project-member</nova:user>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:project uuid="5f4725ed100149debf93e17bee94486a">tempest-SnapshotDataIntegrityTests-523073368</nova:project>
Oct 25 23:23:57 user nova-compute[74507]:       </nova:owner>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:23:57 user nova-compute[74507]:       <nova:ports>
Oct 25 23:23:57 user nova-compute[74507]:         <nova:port uuid="31051495-7b84-468a-9397-ee47549a1baf">
Oct 25 23:23:57 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 23:23:57 user nova-compute[74507]:         </nova:port>
Oct 25 23:23:57 user nova-compute[74507]:       </nova:ports>
Oct 25 23:23:57 user nova-compute[74507]:     </nova:instance>
Oct 25 23:23:57 user nova-compute[74507]:   </metadata>
Oct 25 23:23:57 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:23:57 user nova-compute[74507]:     <system>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="serial">a29c5199-d429-4d09-8298-c0ef3f96f586</entry>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="uuid">a29c5199-d429-4d09-8298-c0ef3f96f586</entry>
Oct 25 23:23:57 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:23:57 user nova-compute[74507]:     </system>
Oct 25 23:23:57 user nova-compute[74507]:   </sysinfo>
Oct 25 23:23:57 user nova-compute[74507]:   <os>
Oct 25 23:23:57 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:23:57 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:23:57 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:23:57 user nova-compute[74507]:   </os>
Oct 25 23:23:57 user nova-compute[74507]:   <features>
Oct 25 23:23:57 user nova-compute[74507]:     <acpi/>
Oct 25 23:23:57 user nova-compute[74507]:     <apic/>
Oct 25 23:23:57 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:23:57 user nova-compute[74507]:   </features>
Oct 25 23:23:57 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:23:57 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:23:57 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:23:57 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:23:57 user nova-compute[74507]:   </clock>
Oct 25 23:23:57 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:23:57 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:23:57 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:23:57 user nova-compute[74507]:   </cpu>
Oct 25 23:23:57 user nova-compute[74507]:   <devices>
Oct 25 23:23:57 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:23:57 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:23:57 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk"/>
Oct 25 23:23:57 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:23:57 user nova-compute[74507]:     </disk>
Oct 25 23:23:57 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:23:57 user nova-compute[74507]:       <mac address="fa:16:3e:79:06:b0"/>
Oct 25 23:23:57 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:23:57 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:23:57 user nova-compute[74507]:       <target dev="tap31051495-7b"/>
Oct 25 23:23:57 user nova-compute[74507]:     </interface>
Oct 25 23:23:57 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:23:57 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/console.log" append="off"/>
Oct 25 23:23:57 user nova-compute[74507]:     </serial>
Oct 25 23:23:57 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:23:57 user nova-compute[74507]:     <video>
Oct 25 23:23:57 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:23:57 user nova-compute[74507]:     </video>
Oct 25 23:23:57 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:23:57 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:23:57 user nova-compute[74507]:     </rng>
Oct 25 23:23:57 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:23:57 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:23:57 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:23:57 user nova-compute[74507]:     </memballoon>
Oct 25 23:23:57 user nova-compute[74507]:   </devices>
Oct 25 23:23:57 user nova-compute[74507]: </domain>
Oct 25 23:23:57 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-771108665',display_name='tempest-SnapshotDataIntegrityTests-server-771108665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-771108665',id=51,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44eb7p7lGLQ8/HPgl9mSqmvfhWAL3bnsQQvUcCM9JkBAylJz3m1LF4T0waoSnIjWlPvUmaKAFEAh60MXlBGjJ6Fq0juSxMtuiGWM6+S/2nWRfV79r9YWxCdeW9qqadkA==',key_name='tempest-keypair-708062190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f4725ed100149debf93e17bee94486a',ramdisk_id='',reservation_id='r-inh15lhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-523073368',owner_user_name='tempest-SnapshotDataIntegrityTests-523073368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1248327921b842d596e8159d9792bab5',uuid=a29c5199-d429-4d09-8298-c0ef3f96f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converting VIF {"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG os_vif [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6472404-4190-5bba-8d8a-c5954156694d', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31051495-7b, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31051495-7b, col_values=(('qos', UUID('06f0048c-64e6-47c3-8252-779f4143ab44')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31051495-7b, col_values=(('external_ids', {'iface-id': '31051495-7b84-468a-9397-ee47549a1baf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:06:b0', 'vm-uuid': 'a29c5199-d429-4d09-8298-c0ef3f96f586'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: INFO os_vif [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b')
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No VIF found with MAC fa:16:3e:79:06:b0, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.neutron [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated VIF entry in instance network info cache for port 31051495-7b84-468a-9397-ee47549a1baf. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG nova.network.neutron [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:23:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3b539927-26e9-4a8a-9a73-7af236fae62e req-85c6fb05-be59-4d5b-8638-5ee122730307 service nova] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:23:58 user nova-compute[74507]: DEBUG nova.compute.manager [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] No waiting events found dispatching network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:23:58 user nova-compute[74507]: WARNING nova.compute.manager [req-469c91b4-8062-454a-b4dc-83412431487c req-4cbd527d-c599-49a0-8fb5-906c2a261e47 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received unexpected event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf for instance with vm_state building and task_state spawning.
Oct 25 23:23:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:23:59 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Skipping network cache update for instance because it is Building. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:24:00 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Instance spawned successfully.
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid 512501d2-d2e3-42f4-82fc-368e6df60bb1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:24:00 user nova-compute[74507]: INFO nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:00 user nova-compute[74507]: DEBUG nova.compute.manager [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] No waiting events found dispatching network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:24:00 user nova-compute[74507]: WARNING nova.compute.manager [req-1417a4dc-5f74-4d7b-8463-714343d4a9ce req-53810d8a-a11f-41b1-9350-7ba15d353cba service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received unexpected event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf for instance with vm_state building and task_state spawning.
Oct 25 23:24:00 user nova-compute[74507]: INFO nova.compute.manager [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Took 6.22 seconds to build instance.
Oct 25 23:24:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-67a72cf0-18a5-4742-9cf3-ae523c3205ad tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.348s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updating instance_info_cache with network_info: [{"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:24:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-512501d2-d2e3-42f4-82fc-368e6df60bb1" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:24:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:24:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:24:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:24:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:24:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:24:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=24.933292388916016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 512501d2-d2e3-42f4-82fc-368e6df60bb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:24:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:24:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:20 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:24:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:27 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:27 user nova-compute[74507]: INFO nova.compute.manager [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Terminating instance
Oct 25 23:24:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-unplugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] No waiting events found dispatching network-vif-unplugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.compute.manager [req-707b02a9-c334-4fc4-8f62-d19b91b4e0d7 req-8c1c3bb2-7e0f-4269-9c82-38ea9288b1db service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-unplugged-4688237a-db5e-492a-9c76-f469f282cd32 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:24:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Instance destroyed successfully.
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.objects.instance [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lazy-loading 'resources' on Instance uuid 512501d2-d2e3-42f4-82fc-368e6df60bb1 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-286043195',display_name='tempest-VolumesNegativeTest-instance-286043195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-286043195',id=50,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14592e5e77d417180dc03c2ac806bfb',ramdisk_id='',reservation_id='r-ifa7chza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1696852972',owner_user_name='tempest-VolumesNegativeTest-1696852972-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:22:44Z,user_data=None,user_id='f630b058335a47579cb8b13b7def1c7b',uuid=512501d2-d2e3-42f4-82fc-368e6df60bb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converting VIF {"id": "4688237a-db5e-492a-9c76-f469f282cd32", "address": "fa:16:3e:53:41:7e", "network": {"id": "308ed32f-1b2f-4c0d-973e-840aff019714", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6fd25a4d98e4177a1d69c306771bb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4688237a-db", "ovs_interfaceid": "4688237a-db5e-492a-9c76-f469f282cd32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG os_vif [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4688237a-db, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f49b680-63fa-4755-b6c2-aed6ad8bff6d) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:28 user nova-compute[74507]: INFO os_vif [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:41:7e,bridge_name='br-int',has_traffic_filtering=True,id=4688237a-db5e-492a-9c76-f469f282cd32,network=Network(308ed32f-1b2f-4c0d-973e-840aff019714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4688237a-db')
Oct 25 23:24:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Deleting instance files /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1_del
Oct 25 23:24:28 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Deletion of /opt/stack/data/nova/instances/512501d2-d2e3-42f4-82fc-368e6df60bb1_del complete
Oct 25 23:24:28 user nova-compute[74507]: INFO nova.compute.manager [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 25 23:24:28 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:24:28 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:24:29 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Took 0.68 seconds to deallocate network for instance.
Oct 25 23:24:29 user nova-compute[74507]: DEBUG nova.compute.manager [req-0a294c61-af56-43dc-b9d2-d57de6bd4fa5 req-9c7b0ddf-f3d0-46a1-8106-7d323a7d7bf6 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-deleted-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:24:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:29 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Deleted allocations for instance 512501d2-d2e3-42f4-82fc-368e6df60bb1
Oct 25 23:24:29 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-719af3e4-0e65-4cd5-8bbf-63f2fe76889a tempest-VolumesNegativeTest-1696852972 tempest-VolumesNegativeTest-1696852972-project-member] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:24:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] Acquiring lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:24:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:24:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] Lock "512501d2-d2e3-42f4-82fc-368e6df60bb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:24:30 user nova-compute[74507]: DEBUG nova.compute.manager [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] No waiting events found dispatching network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:24:30 user nova-compute[74507]: WARNING nova.compute.manager [req-f1e8e13b-f932-4498-9867-50e8ea81d690 req-15543bc0-476d-4456-8e8e-b04243dda094 service nova] [instance: 512501d2-d2e3-42f4-82fc-368e6df60bb1] Received unexpected event network-vif-plugged-4688237a-db5e-492a-9c76-f469f282cd32 for instance with vm_state deleted and task_state None.
Oct 25 23:24:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:24:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:24:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:24:58 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:25:00 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:25:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:25:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:25:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:25:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:03 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:25:06 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=24.931900024414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:25:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:10 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:25:10 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:25:13 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:18 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:25:23 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:28 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:25:33 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:38 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-changed-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:25:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Refreshing instance network info cache due to event network-changed-31051495-7b84-468a-9397-ee47549a1baf. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:25:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:25:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:25:45 user nova-compute[74507]: DEBUG nova.network.neutron [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Refreshing network info cache for port 31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:25:46 user nova-compute[74507]: DEBUG nova.network.neutron [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated VIF entry in instance network info cache for port 31051495-7b84-468a-9397-ee47549a1baf. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:25:46 user nova-compute[74507]: DEBUG nova.network.neutron [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:25:46 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-79905b21-e928-443c-9dbf-52f18189f886 req-61fab828-310d-40e2-a39c-e4247658b626 service nova] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:25:46 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:48 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Starting instance... {{(pid=74507) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:49 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74507) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 23:25:49 user nova-compute[74507]: INFO nova.compute.claims [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Claim successful on node user
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Start building networks asynchronously for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Allocating IP information in the background. {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] allocate_for_instance() {{(pid=74507) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 23:25:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Start building block device mappings for instance. {{(pid=74507) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.policy [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdfd04d797824763890e13c72b012fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b8ee5527504d97a059eefd68c57f72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74507) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Start spawning the instance on the hypervisor. {{(pid=74507) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Creating instance directory {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 23:25:50 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Creating image(s)
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "/opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "/opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "/opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.190s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk 1073741824 {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab,backing_fmt=raw /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk 1073741824" returned: 0 in 0.059s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "f19771e884cacf0122f298fa090fb3f7faa6dbab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:50 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Successfully created port: 79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f19771e884cacf0122f298fa090fb3f7faa6dbab --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk. size=1073741824 {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.virt.disk.api [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Cannot resize image /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk to a smaller size. {{(pid=74507) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Created local disks {{(pid=74507) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Ensure instance console log exists: /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/console.log {{(pid=74507) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Successfully updated port: 79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-changed-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.compute.manager [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Refreshing instance network info cache due to event network-changed-79f80e60-7f77-4f29-8b37-c628dbf48702. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] Acquiring lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] Acquired lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Refreshing network info cache for port 79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-4d076391-b243-422a-9694-079d3e527192 req-aaa005bd-0e9c-4585-9727-8888270835be service nova] Releasing lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquired lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Building network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 23:25:51 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance cache missing network info. {{(pid=74507) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.network.neutron [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Releasing lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance network_info: |[{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74507) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Start _get_guest_xml network_info=[{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '541b34fc-25d4-4dab-841b-3fd7e92cb423'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 23:25:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:25:52 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CPU controller missing on host. {{(pid=74507) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.host [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CPU controller found on host. {{(pid=74507) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74507) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T22:41:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T22:41:49Z,direct_url=<?>,disk_format='qcow2',id=541b34fc-25d4-4dab-841b-3fd7e92cb423,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6fd25a4d98e4177a1d69c306771bb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T22:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Flavor limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Image limits 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Flavor pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Image pref 0:0:0 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Got 1 possible topologies {{(pid=74507) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.hardware [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74507) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:25:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1238059',id=52,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJdg1EcI/lZQU/10s2QOFqwzyp2eG+patD07s9Tre1hLHdhcCJpzumR5UbJw3h1lBQ66cj1jG2zujIYaA1eMJU9Q1c9L7n/Kz+AAxMiN4QREN9kHuebFczRHn2YB4sZ0A==',key_name='tempest-keypair-2020831754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b8ee5527504d97a059eefd68c57f72',ramdisk_id='',reservation_id='r-0lmll2zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdfd04d797824763890e13c72b012fb6',uuid=385317a9-c62f-46f3-ab55-a92404db59b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74507) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converting VIF {"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lazy-loading 'pci_devices' on Instance uuid 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 23:25:52 user nova-compute[74507]:   <uuid>385317a9-c62f-46f3-ab55-a92404db59b7</uuid>
Oct 25 23:25:52 user nova-compute[74507]:   <name>instance-00000034</name>
Oct 25 23:25:52 user nova-compute[74507]:   <memory>524288</memory>
Oct 25 23:25:52 user nova-compute[74507]:   <vcpu>1</vcpu>
Oct 25 23:25:52 user nova-compute[74507]:   <metadata>
Oct 25 23:25:52 user nova-compute[74507]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 23:25:52 user nova-compute[74507]:       <nova:package version="0.0.0"/>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481</nova:name>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:creationTime>2023-10-25 23:25:52</nova:creationTime>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:flavor name="m1.tiny">
Oct 25 23:25:52 user nova-compute[74507]:         <nova:memory>512</nova:memory>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:disk>1</nova:disk>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:swap>0</nova:swap>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:vcpus>1</nova:vcpus>
Oct 25 23:25:52 user nova-compute[74507]:       </nova:flavor>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:owner>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:user uuid="bdfd04d797824763890e13c72b012fb6">tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member</nova:user>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:project uuid="71b8ee5527504d97a059eefd68c57f72">tempest-TestServerVolumeAttachScenarioOldVersion-1174584488</nova:project>
Oct 25 23:25:52 user nova-compute[74507]:       </nova:owner>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:root type="image" uuid="541b34fc-25d4-4dab-841b-3fd7e92cb423"/>
Oct 25 23:25:52 user nova-compute[74507]:       <nova:ports>
Oct 25 23:25:52 user nova-compute[74507]:         <nova:port uuid="79f80e60-7f77-4f29-8b37-c628dbf48702">
Oct 25 23:25:52 user nova-compute[74507]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 23:25:52 user nova-compute[74507]:         </nova:port>
Oct 25 23:25:52 user nova-compute[74507]:       </nova:ports>
Oct 25 23:25:52 user nova-compute[74507]:     </nova:instance>
Oct 25 23:25:52 user nova-compute[74507]:   </metadata>
Oct 25 23:25:52 user nova-compute[74507]:   <sysinfo type="smbios">
Oct 25 23:25:52 user nova-compute[74507]:     <system>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="product">OpenStack Nova</entry>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="version">0.0.0</entry>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="serial">385317a9-c62f-46f3-ab55-a92404db59b7</entry>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="uuid">385317a9-c62f-46f3-ab55-a92404db59b7</entry>
Oct 25 23:25:52 user nova-compute[74507]:       <entry name="family">Virtual Machine</entry>
Oct 25 23:25:52 user nova-compute[74507]:     </system>
Oct 25 23:25:52 user nova-compute[74507]:   </sysinfo>
Oct 25 23:25:52 user nova-compute[74507]:   <os>
Oct 25 23:25:52 user nova-compute[74507]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 23:25:52 user nova-compute[74507]:     <boot dev="hd"/>
Oct 25 23:25:52 user nova-compute[74507]:     <smbios mode="sysinfo"/>
Oct 25 23:25:52 user nova-compute[74507]:   </os>
Oct 25 23:25:52 user nova-compute[74507]:   <features>
Oct 25 23:25:52 user nova-compute[74507]:     <acpi/>
Oct 25 23:25:52 user nova-compute[74507]:     <apic/>
Oct 25 23:25:52 user nova-compute[74507]:     <vmcoreinfo/>
Oct 25 23:25:52 user nova-compute[74507]:   </features>
Oct 25 23:25:52 user nova-compute[74507]:   <clock offset="utc">
Oct 25 23:25:52 user nova-compute[74507]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 23:25:52 user nova-compute[74507]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 23:25:52 user nova-compute[74507]:     <timer name="hpet" present="no"/>
Oct 25 23:25:52 user nova-compute[74507]:   </clock>
Oct 25 23:25:52 user nova-compute[74507]:   <cpu mode="custom" match="exact">
Oct 25 23:25:52 user nova-compute[74507]:     <model>Nehalem</model>
Oct 25 23:25:52 user nova-compute[74507]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 23:25:52 user nova-compute[74507]:   </cpu>
Oct 25 23:25:52 user nova-compute[74507]:   <devices>
Oct 25 23:25:52 user nova-compute[74507]:     <disk type="file" device="disk">
Oct 25 23:25:52 user nova-compute[74507]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 23:25:52 user nova-compute[74507]:       <source file="/opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk"/>
Oct 25 23:25:52 user nova-compute[74507]:       <target dev="vda" bus="virtio"/>
Oct 25 23:25:52 user nova-compute[74507]:     </disk>
Oct 25 23:25:52 user nova-compute[74507]:     <interface type="ethernet">
Oct 25 23:25:52 user nova-compute[74507]:       <mac address="fa:16:3e:3d:81:64"/>
Oct 25 23:25:52 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:25:52 user nova-compute[74507]:       <mtu size="1442"/>
Oct 25 23:25:52 user nova-compute[74507]:       <target dev="tap79f80e60-7f"/>
Oct 25 23:25:52 user nova-compute[74507]:     </interface>
Oct 25 23:25:52 user nova-compute[74507]:     <serial type="pty">
Oct 25 23:25:52 user nova-compute[74507]:       <log file="/opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/console.log" append="off"/>
Oct 25 23:25:52 user nova-compute[74507]:     </serial>
Oct 25 23:25:52 user nova-compute[74507]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 23:25:52 user nova-compute[74507]:     <video>
Oct 25 23:25:52 user nova-compute[74507]:       <model type="virtio"/>
Oct 25 23:25:52 user nova-compute[74507]:     </video>
Oct 25 23:25:52 user nova-compute[74507]:     <rng model="virtio">
Oct 25 23:25:52 user nova-compute[74507]:       <backend model="random">/dev/urandom</backend>
Oct 25 23:25:52 user nova-compute[74507]:     </rng>
Oct 25 23:25:52 user nova-compute[74507]:     <controller type="usb" index="0" model="none"/>
Oct 25 23:25:52 user nova-compute[74507]:     <memballoon model="virtio">
Oct 25 23:25:52 user nova-compute[74507]:       <stats period="10"/>
Oct 25 23:25:52 user nova-compute[74507]:     </memballoon>
Oct 25 23:25:52 user nova-compute[74507]:   </devices>
Oct 25 23:25:52 user nova-compute[74507]: </domain>
Oct 25 23:25:52 user nova-compute[74507]:  {{(pid=74507) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:25:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1238059',id=52,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJdg1EcI/lZQU/10s2QOFqwzyp2eG+patD07s9Tre1hLHdhcCJpzumR5UbJw3h1lBQ66cj1jG2zujIYaA1eMJU9Q1c9L7n/Kz+AAxMiN4QREN9kHuebFczRHn2YB4sZ0A==',key_name='tempest-keypair-2020831754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b8ee5527504d97a059eefd68c57f72',ramdisk_id='',reservation_id='r-0lmll2zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T23:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdfd04d797824763890e13c72b012fb6',uuid=385317a9-c62f-46f3-ab55-a92404db59b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converting VIF {"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG os_vif [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f') {{(pid=74507) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d4ce02c-a60c-5faf-9336-d322f63342c4', '_type': 'linux-noop'}}, row=False) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79f80e60-7f, may_exist=True, interface_attrs={}) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79f80e60-7f, col_values=(('qos', UUID('2d567c19-039d-499f-b239-2f71daa786c7')),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79f80e60-7f, col_values=(('external_ids', {'iface-id': '79f80e60-7f77-4f29-8b37-c628dbf48702', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:81:64', 'vm-uuid': '385317a9-c62f-46f3-ab55-a92404db59b7'}),), if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: INFO os_vif [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f')
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] No VIF found with MAC fa:16:3e:3d:81:64, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.320s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:52 user nova-compute[74507]: INFO nova.compute.manager [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attaching volume 91e912fa-4620-4939-b393-f413b5ef60e3 to /dev/vdb
Oct 25 23:25:52 user nova-compute[74507]: DEBUG os_brick.utils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bc44d4-128e-42fb-8fb3-5835d714618d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:25:52 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f42e5-3e70-4012-a097-537d51ca98dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d456f1c2-e619-46e1-99af-3d10969cd6f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12eb95b-d142-4919-aaec-2e1adbc01332]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:25:53 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea54a7b-cfb3-48a7-9ee3-a2ada0c860c6]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG os_brick.utils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating existing volume attachment record: 38e931c6-5a38-476e-a554-8056021007b4 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:53 user nova-compute[74507]: DEBUG nova.compute.manager [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] No waiting events found dispatching network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:25:53 user nova-compute[74507]: WARNING nova.compute.manager [req-60253d75-b84c-4d22-a88c-1669d3715d40 req-a209adae-f813-4e3a-a4c9-8a7696b33d71 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received unexpected event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 for instance with vm_state building and task_state spawning.
Oct 25 23:25:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance event wait completed in 0 seconds for  {{(pid=74507) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Guest created on hypervisor {{(pid=74507) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 23:25:55 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance spawned successfully.
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_cdrom_bus of ide {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_disk_bus of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_input_bus of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_pointer_model of None {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_video_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Found default for hw_vif_model of virtio {{(pid=74507) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 23:25:55 user nova-compute[74507]: INFO nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Checking state {{(pid=74507) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 23:25:55 user nova-compute[74507]: INFO nova.compute.manager [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Took 6.00 seconds to build instance.
Oct 25 23:25:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f32734f1-11da-4fe9-828c-1649d3cf3f65 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.098s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:25:55 user nova-compute[74507]: DEBUG nova.compute.manager [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] No waiting events found dispatching network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:25:55 user nova-compute[74507]: WARNING nova.compute.manager [req-52b85b43-ff9f-4271-8449-c15a0054069b req-5c8b4be6-61ae-49ba-ada6-ebf5893c51b0 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received unexpected event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 for instance with vm_state active and task_state None.
Oct 25 23:25:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:25:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:26:00 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:26:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:26:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:26:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:26:01 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:07 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:08 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:26:08 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:26:08 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.92040252685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:26:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 385317a9-c62f-46f3-ab55-a92404db59b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:26:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOiCYcXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:26:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:26:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:26:10 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84dbd04-edf6-4e7b-9eef-2eb3f4eec909]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:26:10 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c60c0-76cb-4583-974b-f64bccda99e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3] added
Oct 25 23:26:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e5311-20fd-42a0-bb8f-0cd86e5b81c9]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c0ae0e-f16d-47c0-a376-5bf4f03ff940]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOiCYcXg {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOiCYcXg" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b3936-dea3-4ad0-b2a3-40b9cdd94f4f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOiCYcXg'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec26c19-d691-46f4-9540-5b2c07c085ee]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a40eb39-5ef0-4fb6-80e7-656e7acb77bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:26:10 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:26:10 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:26:10 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:26:10 user nova-compute[74507]: 
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eed745-c943-4060-8c01-b8a3a30d6847]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260]
Oct 25 23:26:10 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260] successful.
Oct 25 23:26:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1881906a-5d89-471c-ac08-61dda4b0007b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccddb3c-1e63-4048-8236-bfe7eeea1bc3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)
Oct 25 23:26:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)
Oct 25 23:26:10 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ee066-4eb1-4d62-b2a7-92f8635fa393]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:26:10 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOiCYcXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23264646666336133', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264646666336133', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.objects.instance [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:26:11 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:26:11 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:26:11 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:26:11 user nova-compute[74507]:   <serial>91e912fa-4620-4939-b393-f413b5ef60e3</serial>
Oct 25 23:26:11 user nova-compute[74507]: </disk>
Oct 25 23:26:11 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No VIF found with MAC fa:16:3e:79:06:b0, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:26:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-9705b350-4086-4bef-befa-792e63fb51f6 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.049s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:26:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:21 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:26:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:26:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:26:44 user nova-compute[74507]: INFO nova.compute.manager [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Detaching volume 91e912fa-4620-4939-b393-f413b5ef60e3
Oct 25 23:26:44 user nova-compute[74507]: INFO nova.virt.block_device [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attempting to driver detach volume 91e912fa-4620-4939-b393-f413b5ef60e3 from mountpoint /dev/vdb
Oct 25 23:26:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Attempting to detach device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:26:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:26:44 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:26:44 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:26:44 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:26:44 user nova-compute[74507]:   <serial>91e912fa-4620-4939-b393-f413b5ef60e3</serial>
Oct 25 23:26:44 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:26:44 user nova-compute[74507]: </disk>
Oct 25 23:26:44 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:26:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config.
Oct 25 23:26:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:26:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:26:44 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:26:44 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:26:44 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:26:44 user nova-compute[74507]:   <serial>91e912fa-4620-4939-b393-f413b5ef60e3</serial>
Oct 25 23:26:44 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:26:44 user nova-compute[74507]: </disk>
Oct 25 23:26:44 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:26:44 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:26:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:26:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:26:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:27:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:27:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:27:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:27:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:27:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:27:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:04 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 is timed out.
Oct 25 23:27:04 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config.
Oct 25 23:27:04 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOiCYcXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:27:04 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3cdaa-20a0-4bb1-aea4-fc268d9e64fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:27:04 user nova-compute[74507]: No targets found.
Oct 25 23:27:04 user nova-compute[74507]: iSNS:
Oct 25 23:27:04 user nova-compute[74507]: No targets found.
Oct 25 23:27:04 user nova-compute[74507]: STATIC:
Oct 25 23:27:04 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3
Oct 25 23:27:04 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:27:04 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:27:04 user nova-compute[74507]: FIRMWARE:
Oct 25 23:27:04 user nova-compute[74507]: No targets found.
Oct 25 23:27:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:27:04 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:27:04 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd25d4-4a5d-426b-aa6f-f58b9433d5b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2f5df-450d-4775-a339-67e3b76b683e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)
Oct 25 23:27:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 (non-flash)
Oct 25 23:27:04 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b64307be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2707733b-a2a9-423b-91b6-4cb519d3d0a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110d67e-96d8-4680-8a70-70ac07ac7134]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:27:04 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfa0cc-b6b2-4b2a-9f52-562137503625]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[516f3872-7c9c-45ab-8ac5-8008db5894d1]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d61afe-44d3-4b9d-97ca-507828aaf779]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5ebc32-148e-4602-9b80-651d15bc2090]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260]
Oct 25 23:27:05 user nova-compute[74507]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3, portal: 172.16.0.220,3260] successful.
Oct 25 23:27:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e912fa-4620-4939-b393-f413b5ef60e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d6fa0-6701-449e-b141-5cc9c9ec2876]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== disconnect_volume: return (268ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:27:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-4f02647b-3e33-49e6-9ce9-688cc2a11448 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:27:06 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:07 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:08 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:09 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:27:09 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:27:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=24.891448974609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 385317a9-c62f-46f3-ab55-a92404db59b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:27:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:27:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:27:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:27:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:27:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:27:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:37 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG nova.objects.instance [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:39 user nova-compute[74507]: INFO nova.compute.manager [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attaching volume 996b4a43-e1aa-431d-9e0b-9dbf8121b054 to /dev/vdb
Oct 25 23:27:39 user nova-compute[74507]: DEBUG os_brick.utils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7397c046-edcb-4281-9e9f-a3189f37de4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3704da-ebfc-4859-85bb-543de8048638]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed8c3fa-36a0-4d2e-b181-8a49d4c5ebc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[750fa3bb-15ad-4cb3-8940-01f4dc76c706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:27:40 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:27:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dffe07-9939-47e7-817d-0d204b72782a]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG os_brick.utils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:27:40 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating existing volume attachment record: ddad3f62-a54e-477c-a8ef-2a577f065c1e {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-changed-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG nova.compute.manager [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Refreshing instance network info cache due to event network-changed-79f80e60-7f77-4f29-8b37-c628dbf48702. {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] Acquiring lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] Acquired lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Refreshing network info cache for port 79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updated VIF entry in instance network info cache for port 79f80e60-7f77-4f29-8b37-c628dbf48702. {{(pid=74507) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG nova.network.neutron [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:27:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-288b6b8a-afd2-4bec-9aae-dd9b0f1ef827 req-88018207-fd1f-4f3b-b379-ca5c1e024a52 service nova] Releasing lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:27:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:27:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lazy-loading 'flavor' on Instance uuid 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:27:47 user nova-compute[74507]: INFO nova.compute.manager [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Attaching volume 4238ed68-9c4a-4257-88b4-abcdb5d89228 to /dev/vdb
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.utils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25465cd1-b35f-45ef-a0ee-cbf5f063614f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9160244-1de7-45b3-92ce-491aa1cde3c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd18b5-0288-4bd7-ba7c-23d120ef472a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe5197-2e89-4ab6-9fe4-b6166356714b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:27:47 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:27:47 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b730e-ee1c-4897-b947-726b12f815c9]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG os_brick.utils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:27:47 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating existing volume attachment record: 280f2bf4-dc0e-4f44-9b12-cbf2477e8bd1 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:27:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omWQzTfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:27:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:27:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:27:57 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[706e27b9-dc78-4315-bf6f-75e1e24e7331]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:27:57 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6550900-61e3-4ffa-adc3-633321bea462]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054] added
Oct 25 23:27:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37cec7-a220-49e5-a957-0644fe91cc3a]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0886a32-afbc-4e4d-8a97-83cb277366e8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omWQzTfj {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omWQzTfj" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a236204-64a3-49e0-bf7a-07a09eed3b75]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'omWQzTfj'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d94b7e-afbf-4a08-8124-70fabe5c8e36]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[802491f4-da38-4971-a8a4-64f5b04dbc29]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:27:57 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:27:57 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:27:57 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:27:57 user nova-compute[74507]: 
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6a5910-6d49-43f9-beb5-efb8b4b1dbb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260]
Oct 25 23:27:57 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260] successful.
Oct 25 23:27:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd966f5-4be7-4780-bd13-90d81a33b811]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f7212b-1456-4636-a46b-d3a9e0c014eb]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:27:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:27:57 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c647de7-bf6a-4023-8327-3e20a47cdea0]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:27:57 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omWQzTfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:27:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:27:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26163613336333366', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:27:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163613336333366', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:27:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:27:58 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:27:58 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:27:58 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:27:58 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:27:58 user nova-compute[74507]:   <serial>996b4a43-e1aa-431d-9e0b-9dbf8121b054</serial>
Oct 25 23:27:58 user nova-compute[74507]: </disk>
Oct 25 23:27:58 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:27:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:27:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:27:59 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No VIF found with MAC fa:16:3e:79:06:b0, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:27:59 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-11c98258-841e-4758-a96b-5b793e8f8e9d tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.362s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:28:00 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:01 user nova-compute[74507]: INFO nova.compute.manager [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Detaching volume 996b4a43-e1aa-431d-9e0b-9dbf8121b054
Oct 25 23:28:01 user nova-compute[74507]: INFO nova.virt.block_device [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attempting to driver detach volume 996b4a43-e1aa-431d-9e0b-9dbf8121b054 from mountpoint /dev/vdb
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Attempting to detach device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:28:01 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:28:01 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:28:01 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:28:01 user nova-compute[74507]:   <serial>996b4a43-e1aa-431d-9e0b-9dbf8121b054</serial>
Oct 25 23:28:01 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:28:01 user nova-compute[74507]: </disk>
Oct 25 23:28:01 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:28:01 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config.
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:28:01 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:28:01 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:28:01 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:28:01 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:28:01 user nova-compute[74507]:   <serial>996b4a43-e1aa-431d-9e0b-9dbf8121b054</serial>
Oct 25 23:28:01 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:28:01 user nova-compute[74507]: </disk>
Oct 25 23:28:01 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:28:02 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:28:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:03 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcUYSrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:28:05 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:28:05 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:28:05 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0369e95-a9c5-4f90-bdf9-9857aa7a993f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:28:05 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102665e-5ea2-4fee-8f38-86a177e6ec65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228] added
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[905cef90-0392-45b5-a080-fcb62043670b]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e58f1f1-7d94-42d5-ab16-aa8ad469fc60]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcUYSrmK {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcUYSrmK" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad81d19-4c1a-408f-a710-b8cea7e0aa57]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcUYSrmK'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d93f79-ec5e-446b-9583-31da7772ab9f]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5111f8f-799f-451f-863c-8ed9d89ce422]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfebbfd-311c-4ebf-9b04-e9da58db2dcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260]
Oct 25 23:28:05 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260] successful.
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa490c-4e6b-4e1a-9805-5ee821a2a769]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d87ab0a-aed4-4435-a7e5-d5dd4ce1dbef]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:05 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c9d0cc-15ed-4213-9066-e5f765ca5ed4]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:05 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcUYSrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23639633061353564', 'path': '/dev/sdc'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639633061353564', 'path': '/dev/sdc'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lazy-loading 'flavor' on Instance uuid 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:28:06 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:28:06 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:28:06 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:28:06 user nova-compute[74507]:   <serial>4238ed68-9c4a-4257-88b4-abcdb5d89228</serial>
Oct 25 23:28:06 user nova-compute[74507]: </disk>
Oct 25 23:28:06 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] No VIF found with MAC fa:16:3e:3d:81:64, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:28:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5e965976-1a49-466f-bc6f-de8c7ad7ac08 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.421s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:08 user nova-compute[74507]: INFO nova.compute.manager [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Detaching volume 4238ed68-9c4a-4257-88b4-abcdb5d89228
Oct 25 23:28:08 user nova-compute[74507]: INFO nova.virt.block_device [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Attempting to driver detach volume 4238ed68-9c4a-4257-88b4-abcdb5d89228 from mountpoint /dev/vdb
Oct 25 23:28:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Attempting to detach device vdb from instance 385317a9-c62f-46f3-ab55-a92404db59b7 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:28:08 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:28:08 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:28:08 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:28:08 user nova-compute[74507]:   <serial>4238ed68-9c4a-4257-88b4-abcdb5d89228</serial>
Oct 25 23:28:08 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:28:08 user nova-compute[74507]: </disk>
Oct 25 23:28:08 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:28:08 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Successfully detached device vdb from instance 385317a9-c62f-46f3-ab55-a92404db59b7 from the persistent domain config.
Oct 25 23:28:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 385317a9-c62f-46f3-ab55-a92404db59b7 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:28:08 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:28:08 user nova-compute[74507]:   <source dev="/dev/sdc"/>
Oct 25 23:28:08 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:28:08 user nova-compute[74507]:   <serial>4238ed68-9c4a-4257-88b4-abcdb5d89228</serial>
Oct 25 23:28:08 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:28:08 user nova-compute[74507]: </disk>
Oct 25 23:28:08 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:28:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:28:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=24.889732360839844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 385317a9-c62f-46f3-ab55-a92404db59b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:28:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:28:11 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:28:11 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:28:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:28:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:12 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:13 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:28:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:22 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 is timed out.
Oct 25 23:28:22 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config.
Oct 25 23:28:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omWQzTfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:28:22 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6935e691-6cb9-4422-8a4f-729fb062edeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:28:22 user nova-compute[74507]: No targets found.
Oct 25 23:28:22 user nova-compute[74507]: iSNS:
Oct 25 23:28:22 user nova-compute[74507]: No targets found.
Oct 25 23:28:22 user nova-compute[74507]: STATIC:
Oct 25 23:28:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054
Oct 25 23:28:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:28:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:28:22 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228
Oct 25 23:28:22 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:28:22 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:28:22 user nova-compute[74507]: FIRMWARE:
Oct 25 23:28:22 user nova-compute[74507]: No targets found.
Oct 25 23:28:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:28:22 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:28:22 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9a7ccf-e7b0-45ae-94b9-23cbd5724994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e0d51-54da-4e2a-be44-82d0522262c1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:22 user nova-compute[74507]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 (non-flash)
Oct 25 23:28:22 user nova-compute[74507]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c418430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6ef2a-2c2a-4a2b-85b7-531e47b928b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f25637e-bcca-4327-a91e-6da4de09c9f5]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf1084-bffc-4cd1-b7a4-a3132ce294f3]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b73ca7d-f200-4694-99d0-141db8f880d0]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e11823c-b19d-4bd3-bd80-ab6a939ff658]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc548e1-ea22-43f0-ad31-92258ef5656e]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260]
Oct 25 23:28:22 user nova-compute[74507]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054, portal: 172.16.0.220,3260] successful.
Oct 25 23:28:22 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:996b4a43-e1aa-431d-9e0b-9dbf8121b054 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d7d306-9d62-41ac-848b-596e09eb281c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== disconnect_volume: return (279ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:22 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:28:23 user nova-compute[74507]: DEBUG nova.objects.instance [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:28:23 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-249cb0fd-3e9c-461d-b690-497b06bfd958 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:27 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:29 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 385317a9-c62f-46f3-ab55-a92404db59b7 is timed out.
Oct 25 23:28:29 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Successfully detached device vdb from instance 385317a9-c62f-46f3-ab55-a92404db59b7 from the live domain config.
Oct 25 23:28:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcUYSrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:28:29 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e88e22-229e-45eb-8550-0a437449e3b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:28:29 user nova-compute[74507]: No targets found.
Oct 25 23:28:29 user nova-compute[74507]: iSNS:
Oct 25 23:28:29 user nova-compute[74507]: No targets found.
Oct 25 23:28:29 user nova-compute[74507]: STATIC:
Oct 25 23:28:29 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228
Oct 25 23:28:29 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:28:29 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:28:29 user nova-compute[74507]: FIRMWARE:
Oct 25 23:28:29 user nova-compute[74507]: No targets found.
Oct 25 23:28:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:28:29 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:28:29 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7969b-0807-4563-9ee1-5edeb8dbc014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c73762-de8b-44c8-96a1-0ff05610b47b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 (non-flash)
Oct 25 23:28:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c2f5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228'): ({'sdc'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Removing single pathed devices sdc {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e290c2-4198-4340-ac78-24ded7f17bd9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c03abbd-bd15-4263-b9e6-bbd34c6855da]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Flushing IO for device /dev/sdc {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b7741-0716-4f30-8157-dc7734d7b444]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[299a2deb-0868-4030-bfc4-acf46f47214a]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] SCSI volumes sdc have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8267f1-f367-4dbe-b8ef-28bcd4abc004]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34072d2a-d8d0-40bd-8a32-468ed1915b45]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260]
Oct 25 23:28:29 user nova-compute[74507]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228, portal: 172.16.0.220,3260] successful.
Oct 25 23:28:29 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4238ed68-9c4a-4257-88b4-abcdb5d89228 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95487a8-f829-483d-9ae0-c4e1d3058ead]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] <== disconnect_volume: return (306ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:28:29 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:28:30 user nova-compute[74507]: DEBUG nova.objects.instance [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lazy-loading 'flavor' on Instance uuid 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:28:30 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-f90e013e-acf0-4d27-a758-103ca808aa52 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:32 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:42 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:47 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:28:52 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:28:57 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:28:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:57 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:28:58 user nova-compute[74507]: INFO nova.compute.manager [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attaching volume 6b737f47-0b80-488a-a99c-62110800536e to /dev/vdb
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f26949-698e-412e-88b0-37d2c6035376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0023e0-7117-44c9-89b7-863c4b4323b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b78b4e-5c2a-4976-b9bc-f4abf86098c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab1264-2de0-46e3-8022-80813f2341d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:28:58 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:28:58 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76c287e-97fd-46ac-bc19-6310eefbf0f0]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG os_brick.utils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:28:58 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating existing volume attachment record: 84127309-7328-42cf-8e5d-acc5a689e141 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:29:02 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:29:03 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [{"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:29:03 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-385317a9-c62f-46f3-ab55-a92404db59b7" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:29:03 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:29:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:06 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:07 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:08 user nova-compute[74507]: INFO nova.compute.manager [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Terminating instance
Oct 25 23:29:08 user nova-compute[74507]: DEBUG nova.compute.manager [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-unplugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] No waiting events found dispatching network-vif-unplugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:29:08 user nova-compute[74507]: DEBUG nova.compute.manager [req-1485d488-b7b4-4a1b-beb1-ade74f364616 req-ffbdde43-c71a-45c9-95b2-36ce64803db3 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-unplugged-79f80e60-7f77-4f29-8b37-c628dbf48702 for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Instance destroyed successfully.
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.objects.instance [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lazy-loading 'resources' on Instance uuid 385317a9-c62f-46f3-ab55-a92404db59b7 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:25:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1238059481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1238059',id=52,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJdg1EcI/lZQU/10s2QOFqwzyp2eG+patD07s9Tre1hLHdhcCJpzumR5UbJw3h1lBQ66cj1jG2zujIYaA1eMJU9Q1c9L7n/Kz+AAxMiN4QREN9kHuebFczRHn2YB4sZ0A==',key_name='tempest-keypair-2020831754',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b8ee5527504d97a059eefd68c57f72',ramdisk_id='',reservation_id='r-0lmll2zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bdfd04d797824763890e13c72b012fb6',uuid=385317a9-c62f-46f3-ab55-a92404db59b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converting VIF {"id": "79f80e60-7f77-4f29-8b37-c628dbf48702", "address": "fa:16:3e:3d:81:64", "network": {"id": "53787852-a637-41c3-a940-3e163f170499", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-396116120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b8ee5527504d97a059eefd68c57f72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79f80e60-7f", "ovs_interfaceid": "79f80e60-7f77-4f29-8b37-c628dbf48702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG os_vif [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79f80e60-7f, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d567c19-039d-499f-b239-2f71daa786c7) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:09 user nova-compute[74507]: INFO os_vif [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:81:64,bridge_name='br-int',has_traffic_filtering=True,id=79f80e60-7f77-4f29-8b37-c628dbf48702,network=Network(53787852-a637-41c3-a940-3e163f170499),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79f80e60-7f')
Oct 25 23:29:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Deleting instance files /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7_del
Oct 25 23:29:09 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Deletion of /opt/stack/data/nova/instances/385317a9-c62f-46f3-ab55-a92404db59b7_del complete
Oct 25 23:29:09 user nova-compute[74507]: INFO nova.compute.manager [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:29:09 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:29:10 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.916683197021484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:29:10 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Took 1.14 seconds to deallocate network for instance.
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-b73a7c55-bb33-4892-93b7-577488a5a5ed req-5b8fab56-8e8a-4736-86ce-0d2b5797fd81 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-deleted-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance 385317a9-c62f-46f3-ab55-a92404db59b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.163s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] Acquiring lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] Lock "385317a9-c62f-46f3-ab55-a92404db59b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:10 user nova-compute[74507]: DEBUG nova.compute.manager [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] No waiting events found dispatching network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:29:10 user nova-compute[74507]: WARNING nova.compute.manager [req-2efae700-22a6-4850-807d-6f8426f6d587 req-ca3f4b1f-9dc8-490a-bc72-492e9afeaf13 service nova] [instance: 385317a9-c62f-46f3-ab55-a92404db59b7] Received unexpected event network-vif-plugged-79f80e60-7f77-4f29-8b37-c628dbf48702 for instance with vm_state deleted and task_state None.
Oct 25 23:29:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:11 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Deleted allocations for instance 385317a9-c62f-46f3-ab55-a92404db59b7
Oct 25 23:29:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-16cb37e7-9f2e-455e-aaf8-2420ad5f4c81 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488 tempest-TestServerVolumeAttachScenarioOldVersion-1174584488-project-member] Lock "385317a9-c62f-46f3-ab55-a92404db59b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:13 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:29:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoylWiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:29:15 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:29:15 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:29:15 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274f9e0-c1e7-4234-baf3-2806e90019fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:29:15 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d509c75-c0d6-4452-b3d3-e25ea4daad6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e] added
Oct 25 23:29:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45b488-3e25-49b2-b0f9-b1b3205ee444]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539c8c0-8a07-4bdf-a137-93049dcd8364]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFoylWiZ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFoylWiZ" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d4cd8-fda9-420b-8fd5-22ef1f64b927]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFoylWiZ'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8be13-6713-4f58-89b5-b1aec8033494]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e3561-ed6a-4ef5-8fdf-e144699b18ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:29:15 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:29:15 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:29:15 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:29:15 user nova-compute[74507]: 
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f7ba56-6847-4f1a-a4b8-607be18f4673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260]
Oct 25 23:29:15 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260] successful.
Oct 25 23:29:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ea491-5875-41cd-8973-f4f711d9814c]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a32c2c-9bdf-4ae4-aabb-39695cfe2ce4]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)
Oct 25 23:29:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)
Oct 25 23:29:15 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbed8126-2170-4fa4-89d4-5b5fb263c8c8]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:29:15 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoylWiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23463363065323631', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463363065323631', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.objects.instance [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:29:16 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:29:16 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:29:16 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:29:16 user nova-compute[74507]:   <serial>6b737f47-0b80-488a-a99c-62110800536e</serial>
Oct 25 23:29:16 user nova-compute[74507]: </disk>
Oct 25 23:29:16 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:29:16 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No VIF found with MAC fa:16:3e:79:06:b0, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:29:17 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-ea5206d3-31ed-4323-a7f8-f1ccbc584973 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.844s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:29:19 user nova-compute[74507]: INFO nova.compute.manager [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Detaching volume 6b737f47-0b80-488a-a99c-62110800536e
Oct 25 23:29:19 user nova-compute[74507]: INFO nova.virt.block_device [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attempting to driver detach volume 6b737f47-0b80-488a-a99c-62110800536e from mountpoint /dev/vdb
Oct 25 23:29:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Attempting to detach device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:29:19 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:29:19 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:29:19 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:29:19 user nova-compute[74507]:   <serial>6b737f47-0b80-488a-a99c-62110800536e</serial>
Oct 25 23:29:19 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:29:19 user nova-compute[74507]: </disk>
Oct 25 23:29:19 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:29:19 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config.
Oct 25 23:29:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:29:19 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:29:19 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:29:19 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:29:19 user nova-compute[74507]:   <serial>6b737f47-0b80-488a-a99c-62110800536e</serial>
Oct 25 23:29:19 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:29:19 user nova-compute[74507]: </disk>
Oct 25 23:29:19 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:29:19 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:29:22 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:39 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 is timed out.
Oct 25 23:29:39 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config.
Oct 25 23:29:39 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFoylWiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:29:39 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0f8ce2-359b-49e3-96dd-a0f6cf7b06d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:29:39 user nova-compute[74507]: No targets found.
Oct 25 23:29:39 user nova-compute[74507]: iSNS:
Oct 25 23:29:39 user nova-compute[74507]: No targets found.
Oct 25 23:29:39 user nova-compute[74507]: STATIC:
Oct 25 23:29:39 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e
Oct 25 23:29:39 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:29:39 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:29:39 user nova-compute[74507]: FIRMWARE:
Oct 25 23:29:39 user nova-compute[74507]: No targets found.
Oct 25 23:29:39 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:29:39 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:29:39 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a4755-660d-4595-923b-46edf0fd72e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:39 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73152cc-f83c-4917-94a5-fded41334859]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)
Oct 25 23:29:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e (non-flash)
Oct 25 23:29:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b6c418430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd9e94b-7a12-4f9d-aac8-bcb77f9cb64e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca1b7b-fbc5-4da9-9bba-c8f0b3d528d4]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83c485f-c769-4c4e-b1de-43441296fa64]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12c6df-e953-4cb2-996b-24593cf09108]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64a3d5-760c-4a3e-8997-ea5ddc4b2984]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb987cc-164c-4175-b30d-8bc1ec6e7aa5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260]
Oct 25 23:29:40 user nova-compute[74507]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e, portal: 172.16.0.220,3260] successful.
Oct 25 23:29:40 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b737f47-0b80-488a-a99c-62110800536e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc12312-4f71-4366-b023-2f3ef6461375]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== disconnect_volume: return (284ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:29:40 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:29:41 user nova-compute[74507]: DEBUG nova.objects.instance [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:29:41 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-e187c207-307c-4f17-aff6-e7d15a109241 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:29:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:29:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:29:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:00 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:02 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:30:04 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:30:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:30:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:30:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:30:05 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:10 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:30:11 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=24.915164947509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:30:11 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:30:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:30:14 user nova-compute[74507]: INFO nova.compute.manager [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attaching volume 97edef4e-a2ec-48ac-8900-2f64ce0f70da to /dev/vdb
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.utils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb4ba69-90ea-455c-a3be-a55a8d475c79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5eed4cff6c2c\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6926e7c-2a90-47ee-8643-2d6348cc4df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedc594-1884-4d90-b453-2f9e1b28f5bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[603e4519-fda0-4e61-98d6-5f91875d6b0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Running cmd (subprocess): nvme version {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] 'nvme version' failed. Not Retrying. {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] nvme not present on system {{(pid=74507) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 23:30:14 user nova-compute[74507]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 23:30:14 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d1009e-3fac-44f4-ac83-4a052516d419]: (4, '') {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74507) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.lightos [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] LIGHTOS: no hostnqn found. {{(pid=74507) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG os_brick.utils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5eed4cff6c2c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:30:14 user nova-compute[74507]: DEBUG nova.virt.block_device [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating existing volume attachment record: 022479e3-2c2b-4c5c-a156-ba3ea387b6f9 {{(pid=74507) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 23:30:15 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:17 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:26 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:30:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Calling os-brick to attach iSCSI Volume {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjNSoQFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:30:30 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:30:30 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:30:30 user nova-compute[74507]: INFO os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a683a941-7df3-4440-af0e-14668301137a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 23:30:30 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --interface default --op new {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d302686-ca71-49a3-a1b5-a736e0c7b1d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da] added\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da] added
Oct 25 23:30:30 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce2fd5-3d5d-4362-bd92-f179098f7b51]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c47a9f-d618-4217-9116-4e79c2509c2d]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:30 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjNSoQFz {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yjNSoQFz" returned: 0 in 0.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8de70a-2130-4b27-a916-7b7f437c30d4]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yjNSoQFz'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e7a66e-4841-4e66-b81e-9bb88c3d5b04]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55dd41f-bb54-4f5c-a92d-121c1d2814ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:30:31 user nova-compute[74507]:  {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 23:30:31 user nova-compute[74507]:  {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:30:31 user nova-compute[74507]: WARNING os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 23:30:31 user nova-compute[74507]: 
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --login {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf1e1e-abb2-4955-b9ba-c524ceb64480]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260]
Oct 25 23:30:31 user nova-compute[74507]: Login to [iface: default, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260] successful.
Oct 25 23:30:31 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6decf8fd-f599-4f5a-9c2b-3838f1621e82]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb802dfe-8a37-45ef-9b47-7ad2aea5199a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)
Oct 25 23:30:31 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)
Oct 25 23:30:31 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to 172.16.0.220:3260 {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74507) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74507) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[503770a9-c50e-48d1-977d-69d8aee41104]: (4, ('- - 0', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:31 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74507) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjNSoQFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74507) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26332323930383866', 'path': '/dev/sdb'} {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323930383866', 'path': '/dev/sdb'} {{(pid=74507) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.objects.instance [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 23:30:32 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:30:32 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:30:32 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:30:32 user nova-compute[74507]:   <serial>97edef4e-a2ec-48ac-8900-2f64ce0f70da</serial>
Oct 25 23:30:32 user nova-compute[74507]: </disk>
Oct 25 23:30:32 user nova-compute[74507]:  {{(pid=74507) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vda, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74507) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] No VIF found with MAC fa:16:3e:79:06:b0, not building metadata {{(pid=74507) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 23:30:32 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-8005cecf-7b8b-4425-a7c7-ea96854b62dd tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.162s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:30:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:30:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:30:35 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:30:35 user nova-compute[74507]: INFO nova.compute.manager [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Detaching volume 97edef4e-a2ec-48ac-8900-2f64ce0f70da
Oct 25 23:30:35 user nova-compute[74507]: INFO nova.virt.block_device [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Attempting to driver detach volume 97edef4e-a2ec-48ac-8900-2f64ce0f70da from mountpoint /dev/vdb
Oct 25 23:30:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Attempting to detach device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config. {{(pid=74507) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 23:30:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:30:35 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:30:35 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:30:35 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:30:35 user nova-compute[74507]:   <serial>97edef4e-a2ec-48ac-8900-2f64ce0f70da</serial>
Oct 25 23:30:35 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:30:35 user nova-compute[74507]: </disk>
Oct 25 23:30:35 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:30:35 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the persistent domain config.
Oct 25 23:30:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config. {{(pid=74507) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 23:30:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.guest [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 23:30:35 user nova-compute[74507]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 23:30:35 user nova-compute[74507]:   <source dev="/dev/sdb"/>
Oct 25 23:30:35 user nova-compute[74507]:   <target dev="vdb" bus="virtio"/>
Oct 25 23:30:35 user nova-compute[74507]:   <serial>97edef4e-a2ec-48ac-8900-2f64ce0f70da</serial>
Oct 25 23:30:35 user nova-compute[74507]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 23:30:35 user nova-compute[74507]: </disk>
Oct 25 23:30:35 user nova-compute[74507]:  {{(pid=74507) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 23:30:35 user nova-compute[74507]: DEBUG nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 23:30:37 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:30:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:30:55 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a29c5199-d429-4d09-8298-c0ef3f96f586 is timed out.
Oct 25 23:30:55 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully detached device vdb from instance a29c5199-d429-4d09-8298-c0ef3f96f586 from the live domain config.
Oct 25 23:30:55 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] calling os-brick to detach iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4b643a4fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yjNSoQFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 23:30:55 user nova-compute[74507]: WARNING os_brick.initiator.connectors.base [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5590ea-4985-45d0-a6af-230dcf127e15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 23:30:55 user nova-compute[74507]: No targets found.
Oct 25 23:30:55 user nova-compute[74507]: iSNS:
Oct 25 23:30:55 user nova-compute[74507]: No targets found.
Oct 25 23:30:55 user nova-compute[74507]: STATIC:
Oct 25 23:30:55 user nova-compute[74507]: Target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da
Oct 25 23:30:55 user nova-compute[74507]:         Portal: 172.16.0.220:3260,-1
Oct 25 23:30:55 user nova-compute[74507]:                 Iface Name: default
Oct 25 23:30:55 user nova-compute[74507]: FIRMWARE:
Oct 25 23:30:55 user nova-compute[74507]: No targets found.
Oct 25 23:30:55 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 23:30:55 user nova-compute[74507]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 23:30:55 user nova-compute[74507]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74507) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da', 0)] {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[50086c08-17a3-461d-8769-d9e47123c620]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[32495398-fe60-4e23-ae2a-df850f7f2bb5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)
Oct 25 23:30:55 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da (non-flash)
Oct 25 23:30:55 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4b642eb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da'): ({'sdb'}, set())}) {{(pid=74507) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Removing single pathed devices sdb {{(pid=74507) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2df34-1561-449f-bfa1-d78a74ced13e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[346c4bcc-0afd-402c-b126-7b0e2a385a0e]: (4, ('ok\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Flushing IO for device /dev/sdb {{(pid=74507) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc56bc-520a-4134-9a0b-4486ace3b047]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74507) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a7fb2-555c-478d-82e5-bf3e367a6cf2]: (4, ('1', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.linuxscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] SCSI volumes sdb have been removed. {{(pid=74507) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da')] {{(pid=74507) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 23:30:55 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b024b0-19b3-4b87-a345-5f32a92d1d96]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --logout {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d733718e-4339-471a-b1db-f9ae963c1c5e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260]
Oct 25 23:30:56 user nova-compute[74507]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da, portal: 172.16.0.220,3260] successful.
Oct 25 23:30:56 user nova-compute[74507]:  stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op delete {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97edef4e-a2ec-48ac-8900-2f64ce0f70da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c6f4b-33b3-470a-8f9b-6ea34bb07ee8]: (4, ('', '')) {{(pid=86030) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74507) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.base [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] <== disconnect_volume: return (277ms) None {{(pid=74507) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Disconnected iSCSI Volume {{(pid=74507) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG nova.objects.instance [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'flavor' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:30:56 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-5d3b26f9-fc77-4a05-b662-c8e0bb946cc0 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:30:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:31:04 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:31:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:31:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:31:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:31:06 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:10 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:31:12 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:31:13 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:31:13 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=24.914119720458984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:31:13 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:31:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:15 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:15 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:31:17 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:31:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:31:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:31:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:32:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquired lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Forcefully refreshing network info cache for instance {{(pid=74507) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 23:32:05 user nova-compute[74507]: DEBUG nova.objects.instance [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lazy-loading 'info_cache' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:32:06 user nova-compute[74507]: DEBUG nova.network.neutron [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [{"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:32:06 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Releasing lock "refresh_cache-a29c5199-d429-4d09-8298-c0ef3f96f586" {{(pid=74507) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 23:32:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updated the network info_cache for instance {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 23:32:08 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:10 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:11 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:32:14 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG oslo_concurrency.processutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74507) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 23:32:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:32:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.913158416748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Instance a29c5199-d429-4d09-8298-c0ef3f96f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74507) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing inventories for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating ProviderTree inventory for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Updating inventory in ProviderTree for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing aggregate associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, aggregates: None {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 23:32:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Refreshing trait associations for resource provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=74507) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 23:32:16 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:32:16 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:32:16 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:32:16 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:19 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:25 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 23:32:25 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] There are 0 instances to clean {{(pid=74507) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 23:32:27 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:27 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74507) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 23:32:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:31 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Triggering sync for uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:42 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:43 user nova-compute[74507]: INFO nova.compute.manager [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Terminating instance
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.compute.manager [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Start destroying the instance on the hypervisor. {{(pid=74507) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-unplugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] No waiting events found dispatching network-vif-unplugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.compute.manager [req-3e0ade32-3e8a-4418-9979-ede296ba6aa2 req-ae6969e2-2b2f-4e87-a8e3-65a8dab863ef service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-unplugged-31051495-7b84-468a-9397-ee47549a1baf for instance with task_state deleting. {{(pid=74507) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: INFO nova.virt.libvirt.driver [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Instance destroyed successfully.
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.objects.instance [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lazy-loading 'resources' on Instance uuid a29c5199-d429-4d09-8298-c0ef3f96f586 {{(pid=74507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.virt.libvirt.vif [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T23:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-771108665',display_name='tempest-SnapshotDataIntegrityTests-server-771108665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-771108665',id=51,image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM44eb7p7lGLQ8/HPgl9mSqmvfhWAL3bnsQQvUcCM9JkBAylJz3m1LF4T0waoSnIjWlPvUmaKAFEAh60MXlBGjJ6Fq0juSxMtuiGWM6+S/2nWRfV79r9YWxCdeW9qqadkA==',key_name='tempest-keypair-708062190',keypairs=<?>,launch_index=0,launched_at=2023-10-25T23:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f4725ed100149debf93e17bee94486a',ramdisk_id='',reservation_id='r-inh15lhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='541b34fc-25d4-4dab-841b-3fd7e92cb423',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-523073368',owner_user_name='tempest-SnapshotDataIntegrityTests-523073368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T23:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1248327921b842d596e8159d9792bab5',uuid=a29c5199-d429-4d09-8298-c0ef3f96f586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converting VIF {"id": "31051495-7b84-468a-9397-ee47549a1baf", "address": "fa:16:3e:79:06:b0", "network": {"id": "0eb4228e-a808-4b39-83f8-e022969979cb", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-610061402-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4725ed100149debf93e17bee94486a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31051495-7b", "ovs_interfaceid": "31051495-7b84-468a-9397-ee47549a1baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG nova.network.os_vif_util [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b') {{(pid=74507) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG os_vif [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b') {{(pid=74507) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31051495-7b, bridge=br-int, if_exists=True) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06f0048c-64e6-47c3-8252-779f4143ab44) {{(pid=74507) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 23:32:43 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:32:44 user nova-compute[74507]: INFO os_vif [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:06:b0,bridge_name='br-int',has_traffic_filtering=True,id=31051495-7b84-468a-9397-ee47549a1baf,network=Network(0eb4228e-a808-4b39-83f8-e022969979cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31051495-7b')
Oct 25 23:32:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Deleting instance files /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586_del
Oct 25 23:32:44 user nova-compute[74507]: INFO nova.virt.libvirt.driver [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Deletion of /opt/stack/data/nova/instances/a29c5199-d429-4d09-8298-c0ef3f96f586_del complete
Oct 25 23:32:44 user nova-compute[74507]: INFO nova.compute.manager [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 23:32:44 user nova-compute[74507]: DEBUG oslo.service.loopingcall [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74507) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 23:32:44 user nova-compute[74507]: DEBUG nova.compute.manager [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Deallocating network for instance {{(pid=74507) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 23:32:44 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] deallocate_for_instance() {{(pid=74507) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 23:32:44 user nova-compute[74507]: DEBUG nova.network.neutron [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Updating instance_info_cache with network_info: [] {{(pid=74507) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 23:32:44 user nova-compute[74507]: INFO nova.compute.manager [-] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Took 0.78 seconds to deallocate network for instance.
Oct 25 23:32:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:44 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:45 user nova-compute[74507]: INFO nova.scheduler.client.report [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Deleted allocations for instance a29c5199-d429-4d09-8298-c0ef3f96f586
Oct 25 23:32:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-129c2874-2ae1-4852-acfd-396debec5514 tempest-SnapshotDataIntegrityTests-523073368 tempest-SnapshotDataIntegrityTests-523073368-project-member] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] Acquiring lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] Lock "a29c5199-d429-4d09-8298-c0ef3f96f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:32:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] No waiting events found dispatching network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 23:32:45 user nova-compute[74507]: WARNING nova.compute.manager [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received unexpected event network-vif-plugged-31051495-7b84-468a-9397-ee47549a1baf for instance with vm_state deleted and task_state None.
Oct 25 23:32:45 user nova-compute[74507]: DEBUG nova.compute.manager [req-23be3e5d-f76b-4b1d-ab2d-a2933e9dfa19 req-07e7813e-1276-4c10-a6fb-e5b21894aaf5 service nova] [instance: a29c5199-d429-4d09-8298-c0ef3f96f586] Received event network-vif-deleted-31051495-7b84-468a-9397-ee47549a1baf {{(pid=74507) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 23:32:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:32:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:32:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:06 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Starting heal instance info cache {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 23:33:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Rebuilding the list of instances to heal {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 23:33:06 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Didn't find any instances for network info cache update. {{(pid=74507) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:09 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:11 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:11 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:12 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:33:14 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Auditing locally available compute resources for user (node: user) {{(pid=74507) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 23:33:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:33:15 user nova-compute[74507]: WARNING nova.virt.libvirt.driver [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=24.940486907958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74507) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74507) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.compute.provider_tree [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed in ProviderTree for provider: 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 {{(pid=74507) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.scheduler.client.report [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Inventory has not changed for provider 9922c2f0-2888-4d6d-8a23-61129bfd5ce8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74507) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG nova.compute.resource_tracker [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Compute_service record updated for user:user {{(pid=74507) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 23:33:15 user nova-compute[74507]: DEBUG oslo_concurrency.lockutils [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74507) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 23:33:17 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:17 user nova-compute[74507]: DEBUG nova.compute.manager [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74507) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 23:33:17 user nova-compute[74507]: DEBUG oslo_service.periodic_task [None req-7d3ce01e-16f0-486b-95cf-6a15e2c5526a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74507) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 23:33:19 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:24 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:29 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:34 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:36 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:39 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:40 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:44 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74507) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74507) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 23:33:49 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:33:54 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 23:33:59 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 23:34:04 user nova-compute[74507]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74507) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}